Playback apparatus, program, playback method

ABSTRACT

When playing an AV Clip recorded on a BD-ROM, a judgment is made, for each elementary stream, which of a plurality of predetermined conditions the elementary stream satisfies. The plurality of predetermined conditions include (a) a condition that a playback apparatus has a capability of playing the elementary stream, (b) a language attribute of the elementary stream matches a language setting of the playback apparatus, and (c) a channel attribute of the elementary stream is surround sound and the playback apparatus has a surround output capability. The playback apparatus assigns a priority to each elementary stream based on which conditions the elementary stream satisfies, selects an elementary stream having a highest priority, and plays the selected elementary stream.

RELATED APPLICATIONS

The present application is a divisional application from U.S. patentapplication Ser. No. 10/558,766 filed on Nov. 22, 2006.

TECHNICAL FIELD

The, present invention relates to a playback apparatus for a recordingmedium, and in particular to an improved function for selecting andplaying back one out of a plurality of elementary streams.

BACKGROUND ART

In distribution of feature films in recent years, there is a tendencyfor a plurality of streams to be multiplexed into a single digitalstream, and particular importance is placed on functions for selectingbetween the streams. There is an increasing number of streams in orderto be compatible with various combinations of codecs, channel numbers,and language attributes.

Here, in codec, when the types are AC-3 (2 ch), AC-3 (5.1 ch), and DTS(5.1 ch) and the language attributes are Japanese and English, an audiostream is multiplexed into a digital stream so as to have a total of sixcombinations. Since a specified number system is attached to these audiostreams, causing the playback device to perform an operation to select,from among the plurality of audio streams, and play back an audio streamhaving the same number as the number set in the status register of theplayback apparatus enables always playing back an audio stream incorrespondence with a determined codec and language attribute.

This set value in the status register can be an initial setting at thetime of factory shipment, or the user can update the status registerafterward. Note that Japanese Patent Application Publication No. 3128220discloses conventional technology for fulfilling the playback functiondescribed above.

DISCLOSURE OF THE INVENTION Problems Solved by the Invention

However, the playback apparatus described above may be placed in aplayback environment in which only stereo playback is possible. When arecording medium on which a surround audio stream is recorded is loadedto a playback apparatus in this playback environment, the playbackapparatus selects the surround audio stream and downmixes it forplayback. However, such downmixing capability is different for differenttypes of playback apparatuses. The downmixing by a low-price playbackapparatus can result in audio output with an extremely poor quality. Theauthoring manufacturer would find such poor quality audio outputundesirable. To avoid this, the authoring manufacturer may record anaudio stream that has been downmixed beforehand to the recording medium,in addition to the surround audio stream. However, the above playbackapparatus will not play back this audio stream unless the user performsan update operation on the status register. Since the status registervalue is not rewritten unless the user changes the status registersetting if the status register is set to a surround stream number, thedownmixed audio stream is inaccessible, even if, for example, thedownmixed audio stream exists on the recording medium.

An aim of the present invention is to provide a playback apparatus thatenables avoiding poor quality playback output when a recording medium isloaded to a playback apparatus capable of playing only stereo.

Means to Solve the Problems

In order to achieve the above aim, the playback device of the presentinvention is a playback apparatus for playing back a video stream and anaudio stream in accordance with playlist information recorded on arecording medium, the playback apparatus characterized by comprising aconfiguration register operable to decode the audio stream and toindicate, for each encoding method, a configuration pertaining towhether surround audio can be output; a language setting registeroperable to indicate a language setting in the playback apparatus; astream number register operable to store a stream number of an audiostream to be played back; a procedure execution unit operable to selectone of a plurality of audio streams by executing a predeterminedprocedure; and a playback unit operable to play back the selected audiostream along with the video stream, wherein the recording mediumincludes a read-only optical disk and a supplementary recording medium,the playlist information includes one or more pieces of playback sectioninformation, the playback section information including playback starttime information, video end time information, and a stream number tablein the video stream, the stream number table indicates a playable audiostream from among a plurality of audio streams recorded on the read-onlyoptical disk and a plurality of audio streams recorded on thesupplementary recording medium, the predetermined procedure includesjudging, for each of a plurality of audio streams indicated in thestream number table, which of a plurality of conditions the audio streamsatisfies, and selecting an audio stream according to a combination ofconditions judged to be satisfied, the plurality of conditions include afirst condition, a second condition, and a third condition, the firstcondition is that an audio stream has been judged to be playable, bycomparing a encoding method of the audio stream with a set value in theconfiguration register, the second condition is that a languageattribute has been judged to match, by comparing a language code of theaudio stream with a set value in the language setting register, thethird condition is that surround output when performing playback hasbeen judged to be possible, by comparing a channel number of the audiostream with the set value of the configuration register, and if there isno audio stream that satisfies all of the first condition, the secondcondition, and the third condition, an audio stream among audio streamssatisfying the first condition and the second condition is selected towhich corresponds an entry in the stream number register at a place thatindicates a first priority, and a stream number of the selected audiostream is set in the stream number register in the playback apparatus.

Effects of the Invention

Since the present invention has the above structure, if there is noaudio stream that satisfies all of the first condition, the secondcondition, and the third condition, an audio stream positioned in apriority entry among audio streams satisfying the first condition andthe second condition is selected. Here, since only stereo is availablein the playback apparatus, when an audio stream downmixed beforehand bythe authoring manufacturer is selected as the audio stream positioned inthe priority entry among audio streams satisfying the first conditionand the second condition (see FIG. 21B), the downmixed audio stream isselected as a higher priority than the surround audio stream, and theaudio stream downmixed beforehand by the authoring manufacturer isprovided for playback (see FIG. 21C). Due to this audio stream beingselected, a decline in the quality of output due to poor downmixingfunction capability does not occur.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1A shows an example of use of a playback apparatus to which thepresent invention relates.

FIG. 1B shows keys on a remote control 400 for receiving a useroperation on an Interactive Display.

FIG. 2 shows a structure of a BD-ROM.

FIG. 3 shows a representation of how an AV Clip is formed.

FIG. 4 shows a structure of Clip information.

FIG. 5 shows a structure of PlayList information.

FIG. 6 shows a representation of indirect referencing by PlayListinformation.

FIG. 7 shows a representation of synchronization of a SubPlayItem usinga sync_PlayItem_id and a synch_start_PTS_of_PlayItem.

FIG. 8 shows a structure of an STN_table.

FIG. 9A shows an entry-attribute combination corresponding to a videostream.

FIG. 9B shows an entry-attribute combination corresponding to an audiostream.

FIG. 9C shows an entry-attribute combination corresponding to a PGstream.

FIG. 9D shows an entry-attribute combination corresponding to textSTstream.

FIG. 9E shows an entry-attribute combination corresponding to an IGstream.

FIG. 10 shows a structure of PlayList information preloaded on an HD.

FIG. 11 shows file designation by Clip_Information_file_names in thePlayList information on the HD.

FIG. 12 shows an internal construction of the playback apparatus towhich the present invention relates.

FIG. 13 shows detailed settings of PSR1, PSR2, PSR15, PSR16, and PSR30.

FIG. 14 shows detailed settings of PSR4 to PSR8.

FIG. 15A shows status transitions that can be made by PSR1.

FIG. 15B is a flowchart of “Procedure when playback condition ischanged” for PSR1.

FIG. 16 is a flowchart of a detailed procedure of step S5.

FIG. 17 shows combinations of playback capabilities and streamattributes in a tabular form.

FIG. 18 shows audio stream selection based on an order of entries in anSTN_table.

FIG. 19 is a flowchart of “Procedure when change is requested” for PSR1.

FIGS. 20A to 20C show a first specific example of audio stream selectionaccording to “Procedure when playback condition is changed”.

FIGS. 21A to 21C show a second specific example of audio streamselection according to “Procedure when playback condition is changed”.

FIGS. 22A to 22C show a third specific example of audio stream selectionaccording to “Procedure when playback condition is changed”.

FIG. 23A shows status transitions that can be made by PSR2.

FIG. 23B is a flowchart of “Procedure when playback condition ischanged” for PSR2.

FIG. 24 is a flowchart of “Procedure when change is requested” for PSR2.

FIG. 25 is a flowchart of an operation of setting PSR2.

FIGS. 26A to 26C show a specific example of PG_textST_stream selectionaccording to “Procedure when playback condition is changed”.

FIG. 27 shows PG_textST_stream selection based on an order of entries inan STN_table.

FIG. 28 shows a structure of PlayList information in a second embodimentof the present invention.

FIG. 29 shows a file structure in the second embodiment.

FIGS. 30A and 30B show multi-angle and non-multi-angle blocks.

FIG. 31 shows detailed settings of PSR3.

FIG. 32A shows status transitions that can be made by PSR3.

FIG. 32B is a flowchart of “Procedure when playback condition ischanged” for PSR3.

FIG. 32C is a flowchart of “Procedure when change is requested” forPSR3.

FIGS. 33A and 33B show how angle blocks are selected.

FIG. 34 shows an IG stream and an ICS in the IG stream.

FIG. 35 shows a structure of button_info.

FIG. 36 show a relationship between an ICS and ODSs in DSn.

FIG. 37 shows overlaying performed with a presentation timing of picturedata pt1.

FIG. 38 shows status transitions of Buttons 1-A to 1-D.

FIG. 39 shows an example of settings of button_info in an ICS.

FIG. 40 shows display switching from Page 1 to Page 2.

FIG. 41 shows detailed settings of PSR0, PSR10, and PSR11.

FIG. 42A shows status transitions that can be made by PSR0.

FIG. 42B is a flowchart of “Procedure when playback condition ischanged” for PSR0.

FIG. 43 is a flowchart of “Procedure when change is requested” for PSR0.

FIG. 44 shows an internal structure of an Interactive Graphics Decoder13.

FIG. 45 is a flowchart of a synchronous control procedure using timestamps.

FIG. 46 is a flowchart of an initial display procedure.

FIG. 47 is a flowchart of an auto-activation procedure.

FIG. 48 is a flowchart of an animation display procedure.

FIG. 49 is a flowchart of a button command execution procedure.

FIG. 50 is a flowchart of an UO procedure.

FIG. 51 is a flowchart of a current button switching procedure.

FIG. 52 shows key operations performed by the user when viewing a dramaseries.

FIG. 53 shows how Pages 1 to 4 shown in FIG. 52 are assigned to aselection menu and a chapter menu.

FIG. 54 shows procedures defined by button commands to achieve focusshifts.

FIG. 55 shows focus shifts performed according to focus positions onprevious Pages.

FIG. 56 shows bugs that can occur in focus shifts.

FIG. 57A shows status transitions that can be made by PSR11.

FIG. 57B is a flowchart of “Procedure when playback condition ischanged” for PSR11.

FIG. 57C is a flowchart of “Procedure when change is requested” forPSR11.

FIG. 58A shows status transitions that can be made by PSR10.

FIG. 58B is a flowchart of “Procedure when playback condition ischanged” for PSR10.

FIG. 59 is a flowchart of “Procedure when change is requested” forPSR10.

BEST MODE FOR CARRYING OUT THE INVENTION First Embodiment

The following describes embodiments of a playback apparatus to which thepresent invention relates. First, an example of an act of using theplayback apparatus according to the present invention is explained. FIG.1 shows an example of use of the playback apparatus according to thepresent invention. In the drawing, the playback apparatus according tothe present invention is a playback apparatus 200, which constitutes ahome theater system together with a television 300 and a remote control400.

A BD-ROM 100 is used for providing a movie film in the home theatersystem that is constituted by the playback apparatus 200, the television300, and the remote control 400.

The remote control 400 receives a user operation directed to theplayback apparatus 200. FIG. 1B shows keys on the remote control 400 forreceiving a user operation on an Interactive Display. As illustrated,the remote control 400 has a Move Up key, a Move Down key, a Move Rightkey, a Move Left key, an audio switch key for receiving an audioswitching operation, a subtitle switch key for receiving a subtitleswitching operation, and numeric keys “0” to “9”.

This concludes the description of the act of using the playbackapparatus according to the present invention.

The BD-ROM which is a recording medium to be played back by the playbackapparatus according to the present invention is described next. FIG. 2shows a structure of the BD-ROM. In the drawing, the fourth level showsthe BD-ROM, and the third level shows a track on the BD-ROM. The trackis shown as being stretched out into a straight line, though inactuality the track spirals outwards from the center of the BD-ROM. Thetrack includes a lead-in area, a volume area, and a lead-out area. Thevolume area has a layer model of a physical layer, a file system layer,and an application layer. The first level shows a format of theapplication layer (application format) of the BD-ROM in a directorystructure. As illustrated, the BD-ROM has a BDMV directory below a ROOTdirectory. The BDMV directory contains files such as YYY.MPLS, XXX.CLPI,XXX.M2TS, ZZZ.M2TS, and ZZZ.CLPI. The XXX.M2TS file corresponds to an AVClip, and the XXX.CLPI file corresponds to Clip information.

The recording medium according to the present invention can be realizedby generating such an application format.

<Structure of the AV Clip>

The AV Clip which is one of the components (AV Clip and Clipinformation) of content of the movie film is described below.

FIG. 3 shows a representation of how the AV Clip is formed.

The AV Clip (middle level) can be created as follows. A video streammade up of a plurality of video frames (pictures pj1, pj2, pj3, . . . )and an audio stream made up of a plurality of audio frames (upper firstlevel) are each converted to PES packets (upper second level), andfurther converted to TS packets (upper third level). Likewise, aPresentation graphics stream (PG stream) for subtitles and anInteractive graphic stream (IG stream) for Interactive Displays (lowerfirst level) are converted to PES packets (lower second level), andfurther converted to TS packets (lower third level). These TS packets ofthe video, audio, and PG and IG streams are then multiplexed to form theAV Clip.

Here, not only the PG stream multiplexed in the AV Clip but also atextST stream forms subtitles. The textST stream is a data string thatrepresents subtitles by text data. The textST stream is called asubClip, and is recorded on the BD-ROM or an HD in the playbackapparatus by a filename different from that of the AV Clip. The PGstream and the textST stream which form subtitles are both called aPG_textST_stream. This concludes the description of the AV Clip.

<Structure of the Clip Information>

The following describes the XXX.CLPI file.

The Clip information (XXX.CLPI) is management information for theindividual AV Clip. FIG. 4 shows a structure of the Clip information.Dotted guidelines in the drawing indicate the structure of the Clipinformation in more detail. As indicated by guideline hn1, the Clipinformation (XXX.CLPI) includes Program.Info and an EP_map used forsearching the video stream for a start of an I picture.

The Program.Info is information showing a PID and an attribute of eachindividual elementary stream multiplexed in the AV Clip, in associationwith a Stream_index. The Stream_index is an index of each individualelementary stream multiplexed in the AV Clip corresponding to this Clipinformation. PIDs of the individual elementary streams identified byStream_indices are shown in Stream_PID [Stream_index] entries indicatedby guideline hn2.

Also, attributes of the individual elementary streams identified by theStream_indices are shown in Stream_Attribute [Stream_index] entriesindicated by guideline hn3. The attributes include video attributes,audio attributes, and graphics attributes. The video attributes show amethod used for compressing a video stream (Coding), a resolution ofpicture data which composes the video stream (Resolution), an aspectratio of the picture data (Aspect), a frame rate of the picture data(Framerate), and the like. The audio attributes show a method used forcompressing an audio stream (Coding), a channel attribute of the audiostream (Ch.), a language attribute of the audio stream (Lang), and thelike. Through the use of a stream_index, an attribute of an elementarystream can be retrieved from the Program.Info.

The EP_map is a reference table for indirect referencing of addresses ofa plurality of locations to which a skip operation is likely to be made,using time information. As indicated by guideline hn5, the EP_mapincludes a plurality of entries (ACCESS UNIT #1 entry, ACCESS UNIT #2entry, ACCESS UNIT #3 entry, . . . ) and the number of entries (Number).

As indicated by guideline hn6, each of the entries shows a playbackstart time of a corresponding I picture, together with an address of theI picture and a size of the I picture (I-Size). The playback start timeof the I picture is expressed using a time stamp (Presentation TimeStamp) of the I picture. The address of the I picture is expressed usinga serial number (SPN (Source Packet Number)) of a TS packetcorresponding to the I picture. It should be noted here that thefilename XXX of the Clip information XXX.CLPI is the same as thefilename of the AV Clip corresponding to the Clip information. Which isto say, the filename XXX of the Clip information in FIG. 4 means theClip information corresponds to the AV Clip XXX.M2TS. This concludes thedescription of the Clip information.

<ZZZ.M2TS and ZZZ.CLPI>

The following describes the ZZZ.M2TS file and the ZZZ.CLPI file. ThesubClip (ZZZ.M2TS) is a file storing a stream that is playedsynchronously with the AV Clip. A representative of such a subClip isthe aforementioned textST stream. Other subClips include an audio streamand an IG stream. The AV Clip shown in FIG. 3 is hereafter also called amain Clip, to distinguish it from the subClip.

The Clip information (ZZZ.CLPI) is Clip information corresponding to thesubClip.

<Structure of the PlayList Information>

The following describes the YYY.MPLS file. The PlayList information(YYY.MPLS) is information which defines a combination of two types ofplayback paths that are a main path and a SubPath, as a PlayList (PL).FIG. 5 shows a data structure of the PlayList information. As shown inthe drawing, the PlayList information includes PlayItem information #1,#2, . . . , #m for defining the main path and SubPath information #1,#2, . . . , #p each for defining the SubPath.

The main path is a playback path defined on an AV Clip which is the mainClip, whereas the SubPath is a playback path defined on a subClip.

The main path is explained first. The main path is defined by aplurality of sets of PlayItem information (PlayItem information #1, #2,#3, . . . , #m) and the number of sets of PlayItem information (Number).PlayItem information defines at least one logical playback sectionincluded in the main path. Guideline hs1 indicates a detailed structureof the PlayItem information. As illustrated, the PlayItem informationincludes a Clip_Information_file_name field showing a filename of Clipinformation of the AV Clip to which an IN point and an OUT point of theplayback section belong, a Clip_codec_identifier field showing a codingmethod of the AV Clip, an IN_time field which is time informationindicating a start of the playback section, an OUT_time field which istime information indicating an end of the playback section, and anSTN_table field showing, among the elementary streams in the AV Clip andits related subClip, elementary streams from which the playbackapparatus can select for presentation of the PlayItem.

The PlayItem information has a feature of being written based onconversion from time information to an addresses. In other words, theplayback section is defined in the form of indirect referencing thatuses the EP_map as a reference table. FIG. 6 shows a representation ofindirect referencing by PlayList information. In the drawing, the AVClip is composed of a plurality of TS packets. The EP_map in the Clipinformation specifies sector addresses of TS packets that correspond tostarts of I pictures, as indicated by arrows ay1, ay2, ay3, ay4, . . . .Arrows jy1, jy2, jy3, jy4, . . . indicate a representation ofreferencing of TS packets by PlayItem information. It can be understoodfrom the drawing that the referencing by the PlayItem information(indicated by arrows jy1, jy2, jy3, jy4, . . . ) is indirect referencingthat specifies addresses of TS packets in the AV Clip through theEP_map.

A playback section on the BD-ROM, which is obtained by a combination ofPlayItem information, Clip information, and an AV Clip, is called aPlayItem. The movie film recorded on the BD-ROM is composed ofPlayItems. Since the movie film recorded on the BD-ROM is composed oflogical playback units, “sharing”, i.e. an AV Clip which forms a sceneof one movie film being referenced by another movie film, can beefficiently conducted.

The variation in movie films can be widened just by defining variouskinds of PlayList information, which enables movie film producers toextend the range of expression. This is a greatest advantage of staticscenario. Playback units of BD-ROMs include not only a PlayItem but alsoa Title and a Chapter. The Title is a playback unit corresponding to onemovie film, and is composed of at least one set of PlayList information.The Chapter is a playback unit corresponding to one chapter of a moviefilm, and is defined by information called Mark information.

The filename YYY of the PlayList information represents a three-digit IDnumber assigned to the PlayList information in the BD-ROM. Which is tosay, the PlayList information shown in FIG. 6 is uniquely identified bythis ID number YYY. The use of “YYY” as the ID number of the PlayListinformation indicates that the ID number of the PlayList information hasa different numbering system from the ID number XXX of the AV Clip andthe Clip information (though the number of digits of the ID number isthree in this example, the number of digits is not limited to such).

This concludes the description of the main path. The SubPath isdescribed next.

<SubPath>

Guideline hc1 in FIG. 5 indicates a structure of SubPath information indetail. As illustrated, the SubPath information is made up of at leastone set of SubPlayItem information. SubPlayItem information includes aClip_Information_file_name field, a Clip_codec_identifier field, aSubPlayItem_IN_time field, a SubPlayItem_OUT_time field, async_PlayItem_id field, and a sync_start_PTS_of_PlayItem field, asindicated by guideline hc2.

The Clip_Information_file_name field shows a filename of Clipinformation of a subClip corresponding to the SubPlayItem, to therebyuniquely identify the subClip.

The Clip_codec_identifier field shows a coding method of the subClip.

The SubPlayItem_IN_time field is time information indicating a start ofthe SubPlayItem on a playback time axis of the subClip.

The SubPlayItem_OUT_time field is time information indicating an end ofthe SubPlayItem on the playback time axis of the subClip.

The sync_PlayItem_id field uniquely identifies one of the PlayItems inthe main path with which the SubPlayItem is to be synchronized. TheSubPlayItem_IN_time is present on a playback time axis of the PlayItemidentified by the sync_PlayItem_id.

The sync_start_PTS_of_PlayItem field specifies the start of theSubPlayItem indicated by the SubPlayItem_IN_time, on the playback timeaxis of the PlayItem identified by the sync_PlayItem_id. When thecurrent playback time has reached a point specified by thissync_start_PTS_of_PlayItem on the playback time axis of the PlayItem,the playback of the SubPlayItem is launched.

FIG. 7 shows a representation of synchronization of the SubPlayItemaccording to the sync_PlayItem_id and the sync_start_PTS_of_PlayItem. Inthe drawing, the main path is made up of PlayItems #1, #2, and #3. Thesync_PlayItem_id and the sync_start_PTS_of_PlayItem of the SubPlayItemwhich forms a SubPath are set as shown in dotted box wh1. In detail, thesync_PlayItem_id is set to specify PlayItem #1, and thesync_start_PTS_of_PlayItem is set to specify time t1 on the playbacktime axis of PlayItem #1. This being the case, when the current playbacktime has reached t1 on the playback time axis of PlayItem #1, playbackof a part of the subClip (textST stream), specified by theClip_Information_file_name, from the SubPlayItem_IN_time to theSubPlayItem_OUT_time is launched. As a result, the part of the textSTstream from the SubPlayItem_IN_time to the SubPlayItem_OUT_time isplayed synchronously with the AV Clip. This concludes the description ofthe SubPath information.

The STN_table field included in the PlayItem information described aboveprovides information used for status settings, and is an essentialfeature of the present invention. The following describes the STN_tablein detail.

<STN_Table>

The STN_table shows elementary streams available for presentation, amongelementary streams multiplexed in the AV Clip specified by theClip_Information_file_name of the PlayItem and elementary streams in asubClip specified by the Clip_Information_file_name of a SubPlayItemrelating to the PlayItem. The STN_table is formed by associating anentry of each elementary stream with its attribute. An elementary streamavailable for presentation is mainly an elementary stream multiplexed inthe AV Clip specified by the PlayItem, but may also include anelementary stream (textST stream) recorded separately from the AV Clipbut played together with the AV Clip.

FIG. 8 shows a structure of the STN_table. As shown in the drawing, theSTN_table includes a plurality of combinations of entries and attributes(entry-attribute), and the numbers of entry-attribute combinations(number_of_video_stream_entries, number_of_audio_stream_entries,number_of_PG_textST_stream_entries, and number_of_IG_stream_entries).

The entry-attribute combinations correspond to a video stream, audiostreams, PG_textST_streams, and IG streams that are available forpresentation in the PlayItem, as indicated by the parenthesis “{”.

The entry-attribute combinations are explained in detail below. FIGS. 9Ato 9D show the entry-attribute combinations in detail.

FIG. 9A shows an entry-attribute combination corresponding to a videostream.

An entry in this entry-attribute combination corresponding to the videostream includes a ref_to_stream_PID_of_mainClip field showing a PID usedfor extracting the video stream when demultiplexing the AV Clip.

An attribute in the entry-attribute combination corresponding to thevideo stream includes a stream_coding_type field which is set to 0x02,and a frame_rate field showing a display rate of the video stream.

FIG. 9B shows an entry-attribute combination corresponding to an audiostream.

An entry in the entry-attribute combination corresponding to the audiostream includes a ref_to_stream_PID_of_mainClip field showing a PID usedfor extracting the audio stream when demultiplexing the AV Clip.

An attribute in the entry-attribute combination corresponding to theaudio stream includes a stream_coding_type field which is set to one of0x80 (Linear PCM), 0x81 (AC-3), and 0x82 (DTS) to indicate a coding typeof the audio stream, an audio_presentation_type field showing a channelstructure of the audio stream and indicating whether surround output ispossible, and an audio_language_code field showing a language attributeof the audio stream.

FIG. 9C shows an entry-attribute combination corresponding to a PGstream.

An entry in the entry-attribute combination corresponding to the PGstream includes a ref_to_stream_PID_of_mainClip field showing a PID usedfor extracting the PG stream when demultiplexing the AV Clip.

An attribute in the entry-attribute combination corresponding to the PGstream includes a stream_coding_type field which is set to 0x90indicating a PG stream codec, and a PG_language_code field showing alanguage attribute of the PG stream.

FIG. 9D shows an entry-attribute combination corresponding to a textSTstream.

An entry in the entry-attribute combination corresponding to the textSTstream includes a ref_to_subClip_entry_id field showing an entryidentifier of a subClip storing the textST stream, a ref_to_SubPath_idfield showing an ID of SubPath information, and aref_to_stream_PID_of_subClip field showing a PID of the textST stream.

An attribute in the entry-attribute combination corresponding to thetextST stream includes a stream_coding_type field which is set to 0x92indicating a textST stream codec, a character_code field showing acharacter code of the textST stream, and a textST_language_code fieldshowing a language attribute of the textST stream.

FIG. 9E shows an entry-attribute combination corresponding to an IGstream.

An entry in the entry-attribute combination corresponding to the IGstream includes a ref_to_stream_PID_of_mainClip field showing a PID usedfor extracting the IG stream when demultiplexing the AV Clip.

An attribute in the entry-attribute combination corresponding to the IGstream includes a stream_coding_type field which is set to 0x91indicating an IG stream codec, and an IG_language_code field showing alanguage attribute of the IG stream. This concludes the description ofthe data structure of the entry-attribute combination of each elementarystream. The order of entries in the STN_table is interpreted as theorder of priorities in stream selection. Also, entries of textST streamsand PG streams are put in one group in the STN_table in order to treatthe PG streams and the textST streams on an equal basis and determinewhich stream out of the PG streams and the textST streams has a higherpriority. For example, if a textST stream has a higher entry than a PGstream in the group of entries for PG_textST_streams in the STN_table,the textST stream is selected over the PG stream. Conversely, if the PGstream has a higher entry than the textST stream in the STN_table, thePG stream is selected over the textST stream.

The above STN_table is provided for each set of PlayList information.Therefore, there may be a case where an entry of one elementary streamis high in an STN_table of one set of PlayList information but low in anSTN_table of another set of PlayList information.

This concludes the description of the data structure of the applicationformat in the BD-ROM. It should be noted here that the recording mediumto be played back by the playback apparatus according to the presentinvention is not limited to the BD-ROM, but also includes the HD in theplayback apparatus. Data recorded on the HD is explained below. The HDstores a file containing a subClip, a file containing Clip information,and a file containing PlayList information, too. These files arepreloaded onto the HD via a network. FIG. 10 shows a structure of suchpreloaded PlayList information. As shown in the drawing, the preloadedPlayList information has a similar structure to the PlayList informationon the BD-ROM shown in FIG. 5. The difference from the one shown in FIG.5 lies in that a Clip_Information_file_name in PlayItem information anda Clip_Information_file_name in SubPlayItem information can eachdesignate Clip information on any of the BD-ROM and the HD. To designateClip information on the BD-ROM, a full path of a file on the BD-ROMneeds not be used in the preloaded PlayList information. This is becausethe playback apparatus recognizes the BD-ROM and the HD together as onevirtual drive (called a virtual package). Accordingly, aClip_Information_file_name in PlayItem information and aClip_Information_file_name in SubPlayItem information in the preloadedPlayList information can designate an AV Clip on any of the HD andBD-ROM, by using a file body, such as XXX or ZZZ, of a file containingClip information. FIG. 11 shows designation of files byClip_Information_file_names in PlayList information on the HD. In thedrawing, arrows rf1, rf2, and rf3 indicate file designation byClip_Information_file_names in PlayItem information in the PlayListinformation, and arrows pf1, pf2, and pf3 indicate file designation byClip_Information_file_names in SubPlayItem information in the PlayListinformation. Through such file designation byClip_Information_file_names, a SubPath defined on a subClip on the HDcan be played synchronously with a main path defined on a main Clip onthe BD-ROM.

Note that the data structures explained above are instances of classstructures written in a programming language. The author writes theclass structures to create these data structures on the BD-ROM.

This concludes the description of the recording medium. The followingdescribes the playback apparatus according to the present invention.FIG. 12 shows an internal construction of the playback apparatusaccording to the present invention. The playback apparatus according tothe present invention is manufactured based on this internalconstruction. The playback apparatus is roughly made up of two partsthat are a system LSI and a drive device. The playback apparatus can bemanufactured by mounting these parts on a cabinet and substrate of theapparatus. The system LSI is an integrated circuit including variousprocessing units for achieving the functions of the playback apparatus.The playback apparatus includes a BD drive 1, a Read Buffer 2, aDemultiplexer 3, a Video Decoder 4, a Video Plane 5, a PresentationGraphics Decoder 9, a Presentation Graphics Plane 10, an adder 11, aFont Generator 12, an Interactive Graphics Decoder 13, a switch 14, anInteractive Graphics Plane 15, an adder 16, an HDD 17, a Read Buffer 18,a Demultiplexer 19, an Audio Decoder 20, a scenario memory 23, a controlunit 24, a switch 25, a CLUT unit 26, a CLUT unit 27, a PSR set 28, andan operation reception unit 29. The control unit 24 includes atransition control unit 30.

The BD drive 1 performs loading and ejecting of the BD-ROM, and accessesto the BD-ROM.

The Read Buffer 2 is a FIFO memory. Accordingly, TS packets read fromthe BD-ROM are removed from the Read Buffer 2 in a same order as theyarrive.

The Demultiplexer (Demux) 3 reads TS packets from the Read Buffer 2 andconverts the TS packets to PES packets. The Demultiplexer 3 outputs PESpackets having a stream ID designated by the control unit 24 to one ofthe Video Decoder 4, the Audio Decoder 20, the Presentation GraphicsDecoder 9, and the Interactive Graphics Decoder 13.

The Video Decoder 4 decodes PES packets output from the Demultiplexer 3to obtain uncompressed pictures, and writes the uncompressed pictures tothe Video Plane 5.

The Video Plane 5 is a plane for storing uncompressed pictures. Here, aplane is a memory area used for storing one screen of pixel data in theplayback apparatus. By providing the playback apparatus with a pluralityof planes and adding the storage contents of these planes forcorresponding pixels, an image output in which a plurality of images areoverlaid on each other can be produced. The Video Plane 5 has aresolution of 1920×1080, and picture data stored on the Video Plane 5 iscomposed of pixel data expressed by 16-bit YUV values.

The Presentation Graphics Decoder 9 decodes a graphics stream read fromthe BD-ROM or the HD to obtain uncompressed graphics, and writes theuncompressed graphics to the Presentation Graphics Plane 10. As a resultof decoding the graphics stream, subtitles are displayed on the screen.

The Presentation Graphics Plane 10 is a memory having one screen ofarea, and is capable of storing one screen of uncompressed graphics. ThePresentation Graphics Plane 10 has a resolution of 1920×1080, and eachpixel in the uncompressed graphics on the Presentation Graphics Plane 10is expressed by an 8-bit index color. By converting the index colorusing a CLUT (Color Lookup Table), the uncompressed graphics on thePresentation Graphics Plane 10 is presented for display.

The adder 11 overlays the storage contents of the Presentation GraphicsPlane 10 on uncompressed picture data (i).

The Font Generator 12 develops text code included in a textST stream toa bitmap, using a character font.

The Interactive Graphics Decoder 13 decodes an IG stream read from theBD-ROM or the HD to obtain uncompressed graphics, and writes theuncompressed graphics to the Interactive Graphics Plane 15.

The switch 14 selectively writes one of a font string generated by theFont Generator 12 and graphics generated by the Presentation GraphicsDecoder 9, to the Presentation Graphics Plane 10.

The Interactive Graphics Plane 15 is used for storing uncompressedgraphics obtained by the Interactive Graphics Decoder 13.

The adder 16 overlays the storage contents of the Interactive GraphicsPlane 15, on picture data (ii) which is generated by overlaying thestorage contents of the Presentation Graphics Plane 10 on theuncompressed picture data (i).

The HDD 17 is the aforementioned HD included in the playback apparatus.By reading the storage contents of the HDD 17 and dynamically combiningthem with the storage contents of the BD-ROM, a graphics stream or atextST stream not recorded on the BD-ROM can be presented.

The Read Buffer 18 is a FIFO memory. Accordingly, TS packets read fromthe HDD 17 are removed from the Read Buffer 18 in the same order as theyarrive.

The Demultiplexer (Demux) 19 reads TS packets from the Read Buffer 18and converts the TS packets to PES packets. The Demultiplexer 19 outputsPES packets having a stream ID designated by the control unit 24, to theFont Generator 12.

The Audio Decoder 20 decodes PES packets output from the Demultiplexer3, and outputs uncompressed audio data.

The scenario memory 23 is used for storing current PlayList informationand current Clip information. The current PlayList information refers toPlayList information that relates to the current playback, among aplurality of sets of PlayList information recorded on the BD-ROM. Thecurrent Clip information refers to Clip information that relates to thecurrent playback, among a plurality of sets of Clip information recordedon the BD-ROM.

The control unit 24 controls reading of an AV Clip from the BD-ROM andplayback of the AV Clip, according to the current PlayList informationand the current Clip information on the scenario memory 23. In detail,the control unit 24 detects the current PlayItem in the current PlayListinformation. With reference to the current Clip information identifiedby a Clip_Information_file_name of the current PlayItem, the controlunit 24 controls the BD-ROM drive 1 to read TS packets from an IN_timeto an OUT_time of the current PlayItem, from an AV Clip specified by thecurrent Clip information. The read TS packets are output selectively tothe Video Decoder 4, the Presentation Graphics Decoder 9, theInteractive Graphics Decoder 13, and the Audio Decoder 20 via theDemultiplexer 3, to play the AV Clip.

If the current PlayList information includes a SubPlayItem to besynchronized with the current PlayItem, the control unit 24 plays asubClip specified by the SubPlayItem synchronously with the main Clip.This synchronization is conducted by playing back data from aSubPlayItem_IN_time to a SubPlayItem_OUT_time of the SubPlayItem whenpicture data corresponding to a sync_start_PTS_of_PlayItem of theSubPlayItem is read from the main Clip.

The switch 25 selectively feeds various data read from the BD-ROM andthe HD to the Read Buffer 2, the Read Buffer 18, and the scenario memory23.

The CLUT unit 26 converts index colors of the uncompressed graphicsstored on the Video Plane 5, to Y, Cr, and Cb values.

The CLUT unit 27 converts index colors of the uncompressed graphicsstored on the Interactive Graphics Plane 15, to Y, Cr, and Cb values.

The PSR set 28 is a register equipped in the playback apparatus, and iscomposed of 64 Player Status Registers (PSRs) and 4096 General PurposeRegisters (GPRs). A definition of a value of each PSR will be explainedin detail later.

The operation reception unit 29 outputs, when an operation of selectinga stream or the like is made on the remote control or a front panel ofthe playback apparatus, user operation information indicating theoperation to the control unit 24.

The transition control unit 30 is included in the control unit 24. Thetransition control unit 30 extracts a stream_PID of an entry-attributecombination corresponding to a PSR from an STN_table in the currentPlayItem information, and outputs the extracted stream_PID to theDemultiplexer 3 or 19. Since the setting of the Stream_PID in theDemultiplexer 3 or 19 is based on the PSR, the transition control unit30 performs a setting operation on the PSR in accordance with acondition change in or a change request to the playback apparatus.

In detail, when a condition change occurs in the playback apparatus, thetransition control unit 30 judges whether a value of the PSR is Valid,Invalid, or undefined. If the value is Valid, the transition controlunit 30 maintains the value. If the value is Invalid or undefined, thetransition control unit 30 sets an optimal value in the PSR.

When a change of the PSR is requested by user operation informationoutput from the operation reception unit 29 or a button command outputfrom the Interactive Graphics Decoder 13, the transition control unit 30determines a value (value X) to be set in the PSR according to the useroperation information or the button command, and performs a PSR updateoperation based on value X. If the user operation information indicatesthat the audio switch key or the subtitle switch key has been pressed,the transition control unit 30 determines a sum of the PSR and 1 asvalue X. If the user operation information indicates that one of thenumeric keys has been pressed, the transition control unit 30 determinesa number corresponding to the pressed numeric key as value X. If thebutton command instructs to set the PSR, on the other hand, thetransition control unit 30 determines a value specified by an argumentof the button command as value X. Once value X has been determined inthis way, the transition control unit 30 judges whether value X isValid, Invalid, or undefined, and performs a PSR update operationdepending on a result of the judgment. In detail, if value X is Valid,the transition control unit 30 overwrites the PSR with value X. If valueX is undefined, the transition control unit 30 selects an optimal valueand sets the optimal value in the PSR. If value X is Invalid, thetransition control unit 30 maintains the value of the PSR.

<PSRs>

This concludes the description of the construction of the playbackapparatus according to the present invention. The following describesindividual PSRs in the PSR set 28. In the PSR set 28, PSR1, PSR2, PSR15,PSR16, and PSR30 relate to selection of audio and subtitles,capabilities of decoding and presenting audio and subtitles, and alanguage setting in the playback apparatus. FIG. 13 shows detailedsettings of PSR1, PSR2, PSR15, PSR16, and PSR30.

PSR1 specifies an audio stream currently selected by the playbackapparatus.

PSR2 includes a disp_flag field, and specifies a PG_textST_streamcurrently selected by the playback apparatus. The disp_flag field is setto 0 to indicate that display of a PG stream and a textST stream isdisabled, and 1 to indicate that display of a PG stream and a textSTstream is enabled.

PSR15 includes an LPCM capability field, an AC-3 capability field, and aDTS capability field. The LPCM capability field is set to 0001_(b) toindicate that the playback apparatus is capable of playing LPCM stereo,and 0010_(b) to indicate that the playback apparatus is capable ofplaying LPCM surround.

The AC-3 capability field is set to 0001_(b) to indicate that theplayback apparatus is capable of playing AC-3 stereo, and 0010_(b) toindicate that the playback apparatus is capable of playing AC-3surround.

The DTS capability field is set to 0001_(b) to indicate that theplayback apparatus is capable of playing DTS stereo, 0010_(b) toindicate that the playback apparatus is capable of playing DTS surround,and 0000_(b) to indicate that the playback apparatus is incapable ofdecoding a DTS audio stream.

PSR16 is set to a value other than 0xFFFF to indicate an audio streamlanguage attribute, and set to 0xFFFF to indicate that no audio streamlanguage attribute is specified.

A most significant bit of PSR30 is set to 0 to indicate that theplayback apparatus is incapable of displaying text subtitles, and set to1 to indicate that the playback apparatus is capable of displaying textsubtitles.

This concludes the explanation of FIG. 13. The following describes PSR4to PSR8 with reference to FIG. 14. FIG. 14 shows detailed settings ofPSR4 to PSR8.

PSR4 is set to one of the values 1 to 100 to indicate a number of aTitle corresponding to the current playback time, and set to 0 toindicate that the current playback time corresponds to a top menu.

PSR5 is set to one of the values 1 to 999 to indicate a number of aChapter corresponding to the current playback time, and set to 0xFFFF toindicate that a Chapter number is invalid in the playback apparatus.

PSR6 is set to one of the values 0 to 999 to indicate a number of aPlayList corresponding to the current playback time (current PlayList).

PSR7 is set to one of the values 0 to 255 to indicate a number of aPlayItem corresponding to the current playback time (current PlayItem).

PSR8 is set to one of the values 0 to 0xFFFFFFFF to indicate the currentplayback time with a time accuracy of 45 KHz (current PTM). Thisconcludes the explanation of PSR4 to PSR8.

<Status Transitions of PSR1>

The following describes status transitions of PSR1 in detail.

PSR1 specifies one of a plurality of audio streams which are listed asentries in the STN_table of the current PlayItem. When PSR1 changes, theplayback apparatus plays back an audio stream specified by the changedPSR1. PSR1 is initially set to 0xFF, and can be reset to any of thevalues 1 to 32 by the playback apparatus. The value 0xFF is an undefinedvalue, indicating that no audio stream is present or no audio stream isselected. The values 1 to 32 are interpreted as audio stream numbers.

FIG. 15A shows status transitions that can be made by PSR1. In thedrawing, the term “Valid” denotes a state where PSR1 is no greater thanthe number of entries in the STN_table of the current PlayItem and alsothe playback apparatus is capable of playing the audio stream.

Meanwhile, the term “Invalid” denotes a state where PSR1 is 0 or greaterthan the number of entries in the STN_table of the current PlayItem.There may be a case where even if PSR1 is no greater than the number ofentries in the STN_table of the current PlayItem, the playback apparatusis incapable of decoding the audio stream.

Procedures for setting PSR1 upon a status transition are schematicallyshown in dotted boxes in FIG. 15A. There are two types of PSR settingprocedures, namely, “Procedure when playback condition is changed” and“Procedure when change is requested”.

“Procedure when playback condition is changed” is a procedure to runwhen the condition of the playback apparatus changes due to theoccurrence of some kind of event.

“Procedure when YYY change is requested” is a procedure to run when theuser requests some kind of change (stream change in the case of FIG.15).

“Procedure when playback condition is changed” and “Procedure whenchange is requested” shown in the dotted boxes are the stream selectionprocedures that constitute the principal features of the presentinvention, and will be explained in detail later with reference toflowcharts.

Each arrow in FIG. 15A represents a status transition of PSR1.

A comment accompanying each arrow denotes an event which triggers astatus transition. In detail, when any of “Load a disc”, “Change aStream”, “Start PlayList playback”, “Cross a PlayItem boundary”, and“Terminate PlayList playback” occurs, PSR1 undergoes a statustransition. In view of this notation, it can be understood from FIG. 15Athat none of the above procedures is performed upon a status transitionfrom Invalid to Invalid and a status transition from Valid to Invalid.On the other hand, each of a status transition from Invalid to Valid anda status transition from Valid to Valid passes one of the procedures. Inother words, to set Valid PSR1, “Procedure when playback condition ischanged” or “Procedure when change is requested” is carried out.

The events which trigger status transitions are explained below.

“Load a disc” is an event of loading the BD-ROM to the playbackapparatus. Upon loading, PSR1 is initially set to an undefined value(0xFF).

“Start PlayList playback” is an event of starting playback based on aPlayList. When this event occurs, “Procedure when playback condition ischanged” is performed, and PSR1 becomes Valid.

“Terminate PlayList playback” is an event of ending playback based on aPlayList. When this event occurs, “Procedure when playback condition ischanged” is not performed, and PSR1 becomes Invalid.

“Change XXX” is an event of receiving a user request to switch XXX(stream in the case of FIG. 15). When this event occurs while PSR1 isInvalid (Cj1 in FIG. 15A), PSR1 is set to a value requested by the user.Even if this set value shows a valid audio stream number, PSR1 istreated as Invalid. Thus, a PSR which is Invalid never changes to Validby “Change XXX”.

When “Change a Stream” occurs while PSR1 is Valid (Cj2), on the otherhand, “Procedure when change is requested” is performed and a new valueis assigned to PSR1. The value assigned to PSR1 here may not be thevalue requested by the user. This is because “Procedure when change isrequested” has a function of excluding an invalid value. PSR1 which isValid never changes to Invalid by “Change a Stream”, since “Procedurewhen change is requested” ensures not to make PSR1 Invalid.

“Cross a PlayItem boundary” is an event where playback crosses over aPlayItem boundary. The PlayItem boundary refers to here is a pointbetween an end of one PlayItem and a beginning of an immediatelysucceeding PlayItem. When this event occurs while PSR1 is Valid,“Procedure when playback condition is changed” is performed. After“Procedure when playback condition is changed”, PSR1 either returns toValid or moves to Invalid. Since an STN_table is provided for eachPlayItem, playable elementary streams change when the current PlayItemchanges. Accordingly, “Procedure when playback condition is changed” isperformed for each PlayItem so as to set PSR1 to a value optimal for thePlayItem.

FIG. 15B is a flowchart of “Procedure when playback condition ischanged” for PSR1. This procedure sets PSR1 through a combination of twojudgment steps S1 and S2.

First, a judgment is made as to whether the number of entries in theSTN_table is 0 (S1). If the number of entries in the STN_table is 0, thevalue of PSR1 is maintained (S3).

When the number of entries in the STN_table is not 0, a judgment is madeas to whether the number of entries in the STN_table is no smaller thanPSR1 and also condition (A) is true (S2). Condition (A) is that theplayback apparatus has a capability of playing an audio stream specifiedby PSR1. If the judgment in step S2 is YES, the value of PSR1 ismaintained (S4). If PSR1 is greater than the number of entries in theSTN_table or Condition (A) is false, PSR1 is set to a new value (S5).

FIG. 16 is a flowchart of a detailed procedure of step S5.

Steps S6 and S7 form a loop in which step S8 is performed for each audiostream listed in the STN_table. In this loop, an audio stream subjectedto processing is called audio stream i. A judgment is made as to whetheraudio stream i satisfies three conditions (a), (b), and (c) (S8).

Condition (a) is that the playback apparatus has a capability of playingaudio stream i. This judgment is made by comparing PSR15 and astream_coding_type of audio stream i shown in the STN_table.

Condition (b) is that a language attribute of audio stream i is same asthe language setting of the playback apparatus. This judgment is made bychecking whether an audio_language_code of audio stream i shown in theSTN_table matches PSR16.

Condition (c) is that a channel attribute of audio stream i is surroundand the playback apparatus has a surround output capability. Thisjudgment is made by comparing PSR15 with an audio_presentation_type andthe stream_coding_type of audio stream i shown in the STN_table.

The following explains a case where condition (c) is satisfied, withreference to FIG. 17. FIG. 17 shows combinations of capabilities of theplayback apparatus and stream attributes in a tabular form. Thecapabilities of the playback apparatus include stereo output andsurround output. The stream attributes include stereo and surround.

When the playback apparatus has a stereo output capability and theattribute of audio stream i is stereo, audio stream i can be playedback.

When the playback apparatus has a surround output capability and theattribute of audio stream i is stereo, audio stream i can be playedback.

When the playback apparatus has a surround output capability and theattribute of audio stream i is surround, audio stream i can be playedback.

When the playback apparatus has a stereo output capability and theattribute of audio stream i is surround, audio stream i can still beplayed back if the playback apparatus downmixes AC-3 (5.1ch) to AC-3(2ch). Thus, audio stream i can be play back with any of the fourcombinations of the capabilities of the playback apparatus and thechannel attributes of audio stream i. However, condition (c) is definedto be true only with one of the four conditions, namely, the playbackapparatus has a surround output capability and the channel attribute ofaudio stream i is surround. Thus, a strict condition is given ascondition (c).

Though condition (c) is defined to be true only with the abovecombination, this is merely one example, and condition (c) may bedefined to be true also with the combination in which the playbackapparatus has a stereo output capability and the channel attribute ofaudio stream i is stereo. In this case, if the playback apparatus isonly capable of stereo output or has been set to prioritize stereooutput over surround output, stereo playback of a 2ch audio stream isselected over downmixed playback of a 5.1 ch audio stream.

Based on a pattern of conditions audio stream i satisfies, that is,which conditions and how many conditions audio stream i satisfies amongthe three conditions, a priority is given to audio stream i.

After the loop is performed for each audio stream, steps S9 to S13 areperformed. A judgment is made as to whether no audio stream satisfiescondition (a) (S9). If there is no audio stream which satisfiescondition (a), PSR1 is set to the undefined value (0xFF) (S14).

A judgment is made as to whether there is any audio stream thatsatisfies all conditions (a), (b), and (c) (S10). If there is such anaudio stream, PSR1 is set to a stream number of that audio stream (S15).

Here, if there are two or more audio streams that satisfy conditions(a), (b), and (c), these audio streams are equal in priority. In such acase, one of the audio streams is selected according to the order ofentries in the STN_table (S15). Which is to say, if there are two ormore audio streams that have a same combination of codec, languageattribute, and channel attribute, one of the audio streams which has ahighest entry in the STN_table is selected as a highest-priority audiostream.

Suppose there are three audio streams that have a same combination ofcodec, language attribute, and channel attribute and respectivelycorrespond to main program sound, commentary sound, and BGM. In thiscase, an entry of the audio stream corresponding to the main programsound is placed first in the STN_table, which is followed by an entry ofthe audio stream corresponding to the commentary sound and an entry ofthe audio stream corresponding to the BGM, as shown in FIG. 18. As aresult, the main program sound is selected automatically over thecommentary sound and the BGM.

Thus, by adjusting the order of audio stream entries in the STN_table,the author can exercise audio stream selection control, i.e. the authorcan specify which audio stream is selected for playback.

When there is no audio stream that satisfies all conditions (a), (b),and (c), a judgment is made as to whether there is any audio stream thatsatisfies conditions (a) and (b) (S11). If there is any audio streamthat satisfies conditions (a) and (b), PSR1 is set to a stream number ofan audio stream having a highest entry in the STN_table among the audiostreams satisfying conditions (a) and (b) (S16).

When there is no audio stream that satisfies all conditions (a), (b),and (c) and no audio stream that satisfies conditions (a) and (b), ajudgment is made as to whether there is any audio stream that satisfiesconditions (a) and (c) (S12). If there is any audio stream thatsatisfies conditions (a) and (c), PSR1 is set to a stream number of anaudio stream having a highest entry in the STN_table among the audiostreams satisfying conditions (a) and (c) (S17).

When there is no audio stream that satisfies all conditions (a), (b),and (c), no audio stream that satisfies conditions (a) and (b), and noaudio stream that satisfies conditions (a) and (c), a judgment is madeas to whether there is any audio stream that satisfies condition (a)(S13). If there is any audio stream that satisfies condition (a), PSR1is set to a stream number of an audio stream having a highest entry inthe STN_table among the audio streams satisfying condition (a) (S18).

This completes “Procedure when playback condition is changed”. Thefollowing describes “Procedure when change is requested”. FIG. 19 is aflowchart of “Procedure when change is requested” for PSR1. Thedifference between this flowchart and the flowchart of FIG. 15B lies inthat X is subjected to judgment instead of PSR1. The value X is based onuser operation information output from the operation reception unit 29or a button command output from the Interactive Graphics Decoder 13.

A judgment is made as to whether the number of entries in the STN_tableis no smaller than X and also condition (A) is true (S19). Condition (A)is that the playback apparatus is capable of playing an audio streamspecified by X. This judgment is made by comparing PSR15 and astream_coding_type of the audio stream shown in the STN_table. If thejudgment in step S19 is YES, PSR1 is set to X (S21).

If X is greater than the number of entries in the STN_table or condition(A) is false, a judgment is made as to whether X is 0xFF (S22). If X isnot 0xFF, it means the audio stream number requested by the user isinvalid, so that the value of PSR1 is maintained with theuser-designated value X being ignored (S23).

If PSR1 is 0xFF, PSR1 is set to a new value (S24). A procedure of step24 is similar to the procedure of step S5 shown in FIG. 16, except forthe following. The judgment of step S9 is not needed in “Procedure whenchange is requested”, because “Procedure when change is requested”maintains the value of PSR1 without setting PSR1 to the user-designatedvalue X if there is no audio stream that satisfies any of conditions(a), (b), and (c).

According to the above “Procedure when playback condition is changed”and “Procedure when change is requested”, an audio stream that isplayable by the playback apparatus and that makes full use of both thefeatures of the BD-ROM and the playback apparatus can be selected.

<Specific Examples of PSR1 Setting>

The procedures shown in the above flowcharts are explained usingspecific examples below.

In one specific example, the playback apparatus is a middle-levelplayback apparatus. The middle-level playback apparatus referred to heredoes not have a DTS decoding capability but has an LPCM decodingcapability and an AC-3 surround output capability. Also, the languagesetting of the playback apparatus is Japanese.

Suppose the BD-ROM on which an STN_table shown in FIG. 20B is recordedis loaded to this playback apparatus. This STN_table lists entries ofsix audio streams.

This being the case, for each audio stream, a judgment is made as towhether conditions (a), (b), and (c) are satisfied in step S8 in FIG.16. For example, audio stream 1 which is listed first in the STN_tablesatisfies only condition (a). Audio stream 2 which is listed second inthe STN_table satisfies conditions (a) and (c).

The judgment on all audio streams reveals that audio stream 5 satisfiesall conditions (a), (b), and (c), audio stream 4 satisfies conditions(a) and (b), audio stream 2 satisfies conditions (a) and (c), and audiostream 1 satisfies condition (a). The other audio streams are excludedfrom selection since they do not satisfy condition (a).

Based on this result, a highest priority is given to audio stream 5 thatsatisfies all conditions (a), (b), and (c), as shown in FIG. 20C. Henceaudio stream 5 is selected and played together with a video stream.

In the above example, the audio stream that satisfies all conditions(a), (b), and (c) is selected. The following considers a case where theplayback apparatus does not have a surround output capability. Supposethe playback apparatus does not have a surround output capability, andan AC-3 (2ch) audio stream and an AC-3 (5.1ch) audio stream aremultiplexed in an AV Clip on the BD-ROM. According to FIG. 17, both ofthe audio streams are playable. Therefore, when these audio streamsundergo the judgment in the procedure shown in FIG. 16, the audiostreams will end up being equal in priority.

In such a case, the STN_table is referenced to select one of the audiostreams. Even if the playback apparatus is incapable of surround output,the playback apparatus can still play back the AC-3 (5.1ch) audio streamby downmixing it to AC-3 (3ch). Such downmixing, however, may result ina lower audio quality at the time of playback than the one intended bythe author. On the other hand, the AC-3 (2ch) audio stream is originallyintended for stereo output. In view of this, the author may prefer AC-3(2ch) playback to downmixed AC-3 (5.1 ch) playback.

In this case, the author places an entry of the AC-3 (2ch) audio streamabove an entry of the AC-3 (5.1ch) audio stream in the STN_table.

As a result, the playback apparatus without a surround output capabilityplays not downmixed AC-3 (5.1ch) audio but AC-3 (2ch) audio. With regardto a bit rate, on the other hand, the AC-3 (5.1 ch) audio stream has abit rate of 384 Kbps whereas the AC-3 (2ch) audio stream has a bit rateof 192 Kbps. Thus, the AC-3 (5.1ch) audio stream has a higher bit ratethan the AC-3 (2ch) audio stream. The author may consider this moreimportant than the audio quality, and prefer downmixed AC-3 (5.1ch)playback to AC-3 (2ch) playback. In this case, the author places theentry of the AC-3 (5.1ch) audio stream above the entry of the AC-3 (2ch)audio stream in the STN_table.

As a result, the playback apparatus without a surround output capabilityplays not AC-3 (2ch) audio but downmixed AC-3 (5.1ch) audio.

The following gives an example of STN_table description and audio streamselection when the author prefers AC-3 (2ch) playback to downmixed AC-3(5.1ch) playback, by referring to FIG. 21.

In this example, the playback apparatus does not have a surround outputcapability, so that PSR15 and PSR16 are set as shown in FIG. 21A.Meanwhile, the STN_table has the same contents as the one in FIG. 20B,as shown in FIG. 21B. In such a case, audio stream 4 and audio stream 5that satisfy conditions (a) and (b) have the same priority “1”, andaudio stream 1 and audio stream 2 that satisfy condition (a) have thesame priority “2”. Since audio streams 4 and 5 are equal in priority,the playback apparatus selects one of audio streams 4 and 5 based on theorder of entries in the STN_table. Since the author prefers AC-3 (2ch)playback to downmixed AC-3 (5.1 ch) playback, the entry of the AC-3(2ch) audio stream is higher than the entry of the AC-3 (5.1ch) audiostream in the STN_table shown in FIG. 21B. In other words, audio stream4 has a higher entry than audio stream 5 in the STN_table. Therefore,the playback apparatus selects audio stream 4 and plays audio stream 4.

The following explains an example of STN_table description and audiostream selection when the author prefers downmixed AC-3 (5.1 ch)playback to AC-3 (2ch) playback, by referring to FIG. 22.

Since the author prefers downmixed AC-3 (5.1 ch) playback, the AC-3(5.1ch) audio streams (audio streams 2 and 5) respectively have higherentries than the AC-3 (2ch) audio streams (audio streams 1 and 4) in theSTN_table shown in FIG. 22B. Which is to say, audio stream 5 is placedabove audio stream 4 in the STN_table. Accordingly, when audio streams 4and 5 satisfy the same conditions (a) and (b), the playback apparatusselects audio stream 5 and plays audio stream 5, as shown in FIG. 22C.

Thus, the author can determine which of AC-3 (2ch) playback anddownmixed AC-3 (5.1ch) playback is performed when the playback apparatusdoes not have a surround output capability. This makes it possible torealize playback control that reflects the preference of the author.This concludes the description of the status control regarding PSR1.

<Status Transitions of PSR2>

The following describes PSR2. PSR2 is used to specify which of aplurality of PG streams and textST streams listed as entries in theSTN_table of the current PlayItem is to be played. When PSR2 is changed,the playback apparatus plays back a PG stream or a textST streamspecified by the changed PSR2. PSR2 is initially set to an undefinedvalue, and can be set to one of the values 1 to 255 by the playbackapparatus. The undefined value is 0xFFFF, indicating that no PG streamor textST stream is present or no PG stream or textST stream isselected. The values 1 to 255 are interpreted as PG_textST_streamnumbers. FIG. 23A shows status transitions that can be made by PSR2. Thestatus transitions shown in FIG. 23A are same as those shown in FIG.15A. FIG. 23B is a flowchart of “Procedure when playback condition ischanged” for PSR2, and FIG. 24 is a flowchart of “Procedure when changeis requested” for PSR2. These flowcharts are respectively similar tothose in FIGS. 15B and 19, but substantially differ in a PSR2 settingprocedure in steps S5 and S23.

FIG. 25 is a flowchart of the PSR2 setting procedure.

In the drawing, steps S31 and S32 form a loop in which steps S33 to S35are performed for each PG_textST_stream listed in the STN_table. In thisloop, the PG_textST_stream subjected to processing is calledPG_textST_stream i. A judgment is made as to whether astream_coding_type of PG_textST_stream i shown in the STN_table is 0x90or 0x92 (S33). If the stream_coding_type is 0x90, the procedure advancesto step S34.

A judgment is made as to whether PG_textST_stream i satisfies thefollowing conditions (a) and (b) (S34).

Condition (a) is that the playback apparatus is capable of playing PGstream i.

Condition (b) is that a language attribute of PG stream i matches thelanguage setting of the playback apparatus.

The judgment for condition (b) is made by checking whether aPG_language_code of PG stream i shown in the STN_table matches PSR17.

If the stream_coding_type is 0x92, a judgment is made as to whetherPG_textST_stream i satisfies the following conditions (a) and (b) (S35).

Condition (a) is that the playback apparatus is capable of playingtextST stream i.

Condition (b) is that a language attribute of textST stream i matchesthe language setting of the playback apparatus.

The judgment for condition (a) is made by checking whether PSR30 shows“capable”. The judgment for condition (b) is made by checking whether atextST_language_code of textST stream i shown in the STN_table matchesPSR17.

After steps S33 to S35 are performed for all PG_textST_streams, theprocedure advances to steps S36 to S41.

A judgment is made as to whether there is no PG_textST_stream thatsatisfies condition (a) (S36). If there is no PG_textST_stream thatsatisfies condition (a), PSR2 is set to an invalid value (0xFFFF) (S38).

A judgment is made as to whether there is any PG_textST_stream thatsatisfies conditions (a) and (b) (S37). If there is such aPG_textST_stream, PSR2 is set to a stream number of a PG_textST_streamhaving a highest entry in the STN_table among PG_textST_streamssatisfying conditions (a) and (b) (S39).

If the judgment in step S37 is NO, PSR2 is set to a stream number of astream having a highest entry in the STN_table among PG streamssatisfying condition (a) and textST_streams satisfying condition (a)(S41). The procedure of this flowchart is explained in more detailbelow, using specific examples.

<Specific Examples of PSR2 Setting>

In one specific example, the playback apparatus is capable of decoding aPG stream but incapable of decoding a textST stream, as shown in FIG.26A. Also, the language setting of the playback apparatus is Japanese.

Suppose the BD-ROM on which an STN_table shown in FIG. 26B is recordedis loaded to this playback apparatus. The STN_table has entries of twotextST streams (PG_textST_streams 1 and 3) and two PG streams(PG_textST_streams 2 and 4).

This being the case, steps S34 and S35 are performed to judge, for eachPG_textST_stream, whether conditions (a) and (b) are satisfied, as shownin FIG. 26C. Here, PG_textST_streams 1 and 3 do not satisfy condition(a), PG_textST_stream 2 satisfies only condition (a), andPG_textST_stream 4 satisfies both conditions (a) and (b).

The judgment on all PG_textST_streams in the STN_table reveals thatPG_textST_stream 4 satisfies conditions (a) and (b) and PG_textST_stream2 satisfies condition (a). PG_textST_streams 1 and 3 do not satisfycondition (a) and so are excluded from selection.

As a result, PG_textST_stream 4 is given a highest priority.

If there are two or more PG_textST_streams that satisfy same conditions,on the other hand, these PG_textST_streams are equal in priority. Insuch a case, one of the PG_textST_streams is selected based on the orderof entries in the STN_table.

A specific example of PG_textST_stream selection according to the orderof entries in the STN_table is given below, by referring to FIG. 27. Inthis specific example, the playback apparatus is capable of decodingboth a PG stream and a textST stream. When there are a PG stream and atextST stream that have a language attribute which matches the languagesetting of the playback apparatus, the PG stream and the textST streamare equal in priority. In this case, the author places an entry of apreferred stream above an entry of the other stream in the STN_table. Ifthe author prefers the textST stream to the PG stream, the author placesan entry of the textST stream above an entry of the PG stream in theSTN_table. As a result, the textST stream is selected automatically overthe PG stream.

Thus, by adjusting the order of entries in the STN_table, the author canexercise selection control of which stream is to be selected at the timeof playback.

<Modifications>

The first embodiment describes the case where if X is invalid in“Procedure when change is requested”, the transition control unit 30maintains the value of PSR1 or PSR2. This process is not desirable,however, in the case where the user presses the audio switch key or thesubtitle switch key. When the audio switch key or the subtitle switchkey is pressed, X should be PSR+1. If, despite this, the value of PSR1or PSR2 is maintained on the ground that X is invalid, the user maythink that the playback apparatus malfunctions.

In view of this, when the audio switch key or the subtitle switch key ispressed, the transition control unit 30 performs the following processin addition to “Procedure when change is requested”. In this process,when executing “Procedure when change is requested”, the value of thePSR before “Procedure when change is requested” is compared with thevalue of the PSR after “Procedure when change is requested”. If the twovalues are equal, X is incremented by 1, and “Procedure when change isrequested” is performed again. X is incremented until the value of thePSR is updated by “Procedure when change is requested”.

Once the value of the PSR has been updated by “Procedure when change isrequested”, the comparison of the two values results in a mismatch. Thevalue of the PSR obtained by “Procedure when change is requested” atthis point is used for stream selection.

This process is explained briefly below, using a specific example wherePSR1 is set to 3 and stream numbers 4 and 5 are invalid. The transitioncontrol unit 30 adds 1 to PSR1, and sets 4 as X. The transition controlunit 30 then performs “Procedure when change is requested”. Since thestream number 4 is invalid, PSR1 remains 3. When PSR1 is unchanged likethis, the transition control unit 30 increments X by 1, to thereby set Xto 5. Having done so, the transition control unit 30 performs “Procedurewhen change is requested” again. Since the stream number 5 is invalid,PSR1 remains 3. When PSR1 is unchanged like this, the transition controlunit 30 increments X by 1, to thereby set X to 6. Having done so, thetransition control unit 30 performs “Procedure when change is requested”again. Since the stream number 6 is valid, the stream number 6 isautomatically selected as a result of “Procedure when change isrequested”. By performing the above process when the audio switch key ispressed, smooth audio switching can be achieved without making the usernotice the existence of an invalid stream number.

Second Embodiment

A second embodiment of the present invention relates to status settingsfor multi-angle blocks. A data structure for realizing a multi-angleblock can be provided in the PlayItem information shown in FIG. 5. FIG.28 shows a data structure of PlayItem information corresponding to amulti-angle block. In the drawing, the PlayItem information is made upof a basic part that is compatible with PlayItem informationcorresponding to a non-multi-angle block, and an extension part forrealizing the multi-angle block. The basic part has a same datastructure as the one shown in FIG. 5, and includes aClip_Information_file_name field, a Clip_codec_identifier field, anIN_time field, an OUT_time field, and an STN_table field. In themulti-angle block, an AV Clip specified by this basic part is treated asa first angle block. In this way, even if a playback apparatus that doesnot support multi-angle (a playback apparatus that corresponds only to aBD-RE data structure) reads PlayItem information corresponding to amulti-angle block, the playback apparatus can play the first angle blockby referencing the basic part. Meanwhile, the extension part is made upof an is_multi_angles field, a number_of_angles field, and Angleinformation [2], . . . , [j].

The is_multi_angles field shows whether a playback section correspondingto the PlayItem information is a multi-angle block or a non-multi-angleblock.

The number_of_angles field shows, when the is_multi_angles field shows amulti-angle block, the number of angles in the multi-angle block.

The Angle information [2], . . . , [j] is information for eachindividual angle block in the multi-angle block, and includes aClip_Information_file_name field and a Clip_codec_identifier field.

The Clip_Information_file_name field shows a filename of an AV Clip thatforms the angle block.

The Clip_codec_identifier field shows a coding method of the AV Clipspecified by the filename shown by the Clip_Information_file_name fieldin the Angle information.

As shown in the drawing, the Angle information does not have an IN_timefield and an OUT_time field. This is because a beginning and end of eachangle block except the first angle block are specified by the IN_timefield and the OUT_time field in the basic part. In other words, aplayback time of the AV Clip specified by the Clip_Information_file_namefield in the Angle information needs to be same as a playback time ofthe AV Clip specified by the Clip_Information_file_name field in thebasic part. Also, time stamps (System Time Clock) which specifypresentation timings on the AV Clip playback time axis need to be equalfor the two AV Clips.

A specific example of a PlayItem corresponding to a multi-angle block isgiven below. In this specific example, three PlayItems (PlayItems #1,#2, and #3) are used. Of these PlayItems, PlayItems #1 and #3 constitutemulti-angle blocks, whereas PlayItem #2 constitutes a non-multi-angleblock. Also, a plurality of AV Clips shown in FIG. 29 (FRONT1, RIGHT1,LEFT1, FRONT2, FRONT3, and RIGHT 2) are recorded on the BD-ROM.Clip_Information_file_names of PlayItem #1 specify FRONT1, LEFT1, andRIGHT1, a Clip_Information_file_name of PlayItem #2 specifies FRONT2,and Clip_Information_file_names of PlayItem #3 specify FRONT3 andRIGHT2. These PlayItems define a main path that is made up of amulti-angle block, a non-multi-angle block, and a multi-angle block inthis order. FIGS. 30A and 30B show the multi-angle blocks andnon-multi-angle block defined in this way. In the drawing, arrows my1and my2 indicate designation by two sets of Angle information inPlayItem #1, and arrow my3 indicates designation by one set of Angleinformation in PlayItem #3. According to the designation my1 and my2 bythe two sets of Angle information in PlayItem #1, one of RIGHT1 andLEFT1 can be selected for playback instead of part of the AV Clip.Likewise, according to the designation my3 by the set of Angleinformation in PlayItem #3, RIGHT2 can be selected for playback insteadof part of the AV Clip.

FIG. 30B shows a progress of playback of the multi-angle blocks andnon-multi-angle block. As indicated by arrows ag1, ag2, and ag3, one ofthe three angle blocks can be selected in multi-angle block 1. Also, asindicated by arrows ag4 and ag5, one of the two angle blocks can beselected in multi-angle block 3. This concludes the description of theimprovements in the recording medium of the second embodiment.

The following describes improvements in the playback apparatus of thesecond embodiment. In the playback apparatus, PSR3 specifies an angleblock. In the second embodiment, the control unit 24 controls angleblock selection and playback according to PSR3.

In detail, the control unit 24 references PSR3, upon playback of thecurrent PlayItem in the current PlayList. If PSR3=1, the control unit 24controls the BD-ROM drive 1 to access an AV Clip specified by aClip_Information_file_name in the basic part of the current PlayItem andread TS packets of the AV Clip from an IN_time to an OUT_time in thecurrent PlayItem. The read TS packets are fed to the Video Decoder 4 toplay an angle block.

If PSR3 is 2 or more, the control unit 24 controls the BD-ROM drive 1 toaccess an AV Clip (aforementioned RIGHT1, LEFT1, or RIGHT2) specified bya Clip_Information_file_name in Angle Information in the extension partof the current PlayItem, and read TS packets of the AV Clip. The read TSpackets are fed to the Video Decoder 4 to play an angle block. Thus, byaccessing a different AV Clip depending on the value of PSR3, selectiveplayback of angle blocks can be achieved.

PSR3 which specifies an angle block is explained below. FIG. 31 showssettings of PSR3. PSR3 specifies a number of an angle block that iscurrently selected. PSR3 takes one of the values 1 to 9, to specify oneof angle blocks 1 to 9.

Status transitions of PSR3 are explained below. FIG. 32A shows statustransitions that can be made by PSR3. When comparing this drawing withFIG. 15A, it can be understood that there is no status transitiontriggered by “Cross a PlayItem boundary”. Also, “Start PlayListplayback” and “Terminate PlayList playback” have been replacedrespectively with “Start PlayItem with multi angle structure” and “Endof a PlayItem with multi angle structure”. Further, “Procedure whenchange is requested” has been changed from “stream change is requested”to “angle change is requested”. Apart from these differences, the statustransitions of PSSR3 are same as those shown in FIG. 15A.

The number of audio streams differs for each PlayItem. Accordingly, whenplayback of a PlayList starts and each time the playback crosses aPlayItem boundary, “Procedure when playback condition is changed” needsto be performed to set PSR1. On the other hand, PSR3 is used only in amulti-angle block, and so there is no need to perform “Procedure whenplayback condition is changed” each time a PlayItem boundary is crossed.Therefore, a status transition from Invalid to Valid is triggered by astart of playback of a multi-angle block, and a status transition fromValid to Invalid is triggered by an end of playback of a multi-angleblock.

In this embodiment, the value of PSR3 is maintained upon the statustransition from Valid to Invalid. Which is to say, when a multi-angleblock and a non-multi-angle block appear alternately (e.g. FIG. 30),only the state of PSR3 is changed from Valid to Invalid and vice versa,without changing the value of PSR3. This concludes the description ofthe status transitions of PSR3. The following describes “Procedure whenplayback condition is changed” and “Procedure when change is requested”for PSR3.

FIG. 32B is a flowchart of “Procedure when playback condition ischanged” for PSR3. This flowchart has a similar algorithm to the oneshown in FIG. 15B. A judgment is made as to whether the number of anglesin the current PlayItem is no smaller than PSR3 (S51). If the number ofangles in the current PlayItem is no smaller than PSR3, the value ofPSR3 is maintained (S53). Otherwise, PSR3 is set to an initial value “1”(S52).

FIG. 32C is a flowchart of “Procedure when change is requested” forPSR3. This flowchart has a similar algorithm to the one shown in FIG.19. A judgment is made as to whether the number of angles in the currentPlayItem is no smaller than X (S54). If the number of angles in thecurrent PlayItem is no smaller than X, PSR3 is set to X (S57).Otherwise, the value of PSR3 is maintained (S55).

Angle block selection performed when playing the multi-angle block, thenon-multi-angle block, and the multi-angle block in this order accordingto the three PlayItems shown in FIG. 30 is explained below, by referringto FIG. 33.

In FIG. 33A, PSR3 is set to 2. This being so, when playback of PlayItem#1 starts, the control unit 24 selects an angle block (RIGHT1) specifiedby PSR3=2 and plays the selected angle block. Once the playback ofRIGHT1 ends, PSR3 is changed to Invalid while being held at 2.

Multi-angle block #1 specified by PlayItem #1 is followed bynon-multi-angle block #2 specified by PlayItem #2. Since this is anon-multi-angle block, PSR3 remains Invalid. Which is to say, PSR3 istreated as Invalid while being held at 2. Since PSR3 is Invalid, thecontrol unit 24 plays part of the AV Clip (XXX.M2TS) from an IN_time toan OUT_time of PlayItem #2, irrespective of the value of PSR3.

Non-multi-angle block #2 is followed by multi-angle block #3 specifiedby PlayItem #3. When playback of multi-angle block #3 begins, PSR3 ischanged from Invalid to Valid while being held at 2. Since PSR3 becomesValid, an angle block specified by PSR3 is selected. Here, PSR3=2, sothat the control unit 24 selects an angle block (RIGHT2) specified byPSR3=2 and plays the selected angle block. Arrow gg1 in FIG. 33Aindicates a course of angle block selection described above.

The above concerns the case where PSR3 is set to 2. The followingexplains the case where PSR3 is set to 3. In FIG. 33B, playback ofmulti-angle block #1 is performed as in FIG. 33A. After this, PSR3 ischanged to Invalid while being held at 3 as a result of the statustransition shown in FIG. 32A, and playback of non-multi-angle block #2is performed in this state. After the playback of non-multi-angle block#2, playback of multi-angle block #3 starts. Since this is the “StartPlayItem with multi angle structure” event, “Procedure when playbackcondition is changed” is performed. In step S51 in FIG. 32B, a judgmentis made as to whether PSR3 exceeds the number of angles in PlayItem #3.Since the number of angles in PlayItem #3 is 2, PSR3=3 exceeds thenumber of angles. Accordingly, PSR3 is set to 1 (S52). As a result, theAV Clip XXX.M2TS corresponding to the first angle block in PlayItem #3is selected and played back, as shown in FIG. 33B. Arrow gg2 in FIG. 33Bindicates a course of angle block selection in this case.

According to the second embodiment, PSR3 makes such status transitionsthat avoid selecting a nonexistent angle block. Accordingly, even whenswitching from a multi-angle block to a non-multi-angle block and viceversa occur frequently, a wrong number will not be set in PSR3. Thisensures the accuracy in angle selection, with it being possible tofacilitate distribution of movie films that incorporate multi-angle.

Third Embodiment

A third embodiment of the present invention relates to status settingswhen executing an interactive function. The interactive functionreferred to here provides a plurality of Pages, places graphics Buttonmembers on each Page, and receives a user operation. When executing theinteractive function, this embodiment performs status settings aboutwhich Page is to be displayed and which Button on that Page is to befocused.

<Data Structure for the Interactive Function>

A data structure for displaying a plurality of Pages and Buttons can beprovided in the IG stream described in the first embodiment. The IGstream is explained below, with reference to FIG. 34. The IG streamincludes an ICS, a PDS, and an ODS. The ODS is graphics data fordisplaying a Button graphically. The PDS is pallet data for specifying acolor of the Button.

The ICS is control information for displaying a Page synchronously witha moving picture. The synchronization with the moving picture isdesignated by a DTS and a PTS in a PES packet carrying the ICS. That is,the DTS in the PES packet carrying the ICS shows a beginning of a periodduring which the interactive function is valid (a period during whichthe ICS is Valid).

Arrow cu1 in FIG. 34 indicates a structure of the ICS in detail. Asillustrated, the ICS includes a loading_model field, auser_interface_model field, a composition_time_out_pts field, aselection_time_out_pts field, a user_time_out_duration field, and pageinformation (1), (2), . . . , (i), . . . , (n) which each correspond toa different one of a plurality of Pages available for presentation.

The loading_model field shows whether the IG stream is multiplexed inthe AV Clip or is preloaded in the playback apparatus separately fromthe AV Clip.

The user_interface_model field shows whether a Page is constantlydisplayed (Always-on) or popped up based on a user operation (Pop-up),during the playback of the moving picture.

The composition_time_out_pts field shows an end of the period duringwhich the interactive function is valid.

The user_time_out_duration field shows a period of time after which Pagedisplay is to time-out if there is no user operation.

The page information is explained below. Arrow cu2 in FIG. 34 indicatesa structure of the page information in detail. As illustrated, the pageinformation includes a page_id field, a UO_mask_table field, anin_effects field, an out_effects field, an animation_frame_rate_codefield, a default_selected_button_id_ref field, adefault_activated_button_id_ref field, a pallet_id_ref field, andbutton_info (1), (2), . . . , (i), . . . ,(n) each corresponding to adifferent one of a plurality of Buttons.

The page_id field shows an identifier uniquely identifying a Pagecorresponding to the page information.

The UO_mask_table field shows permissions/prohibitions of useroperations in a Display Set (DS) to which the ICS belongs. If this maskfield is set to “Prohibited” for a user operation, that user operationto the playback apparatus is invalid.

The in_effects field shows a display effect to be presented immediatelybefore the Page is displayed.

The out_effects field shows a display effect to be presented immediatelyafter the Page is removed from display.

The animation_frame_rate_code field shows a frame rate to be applied toan animated Button.

The default_selected_button_id_ref field shows whether a Button to beset in a selected state as default when the presentation of theInteractive Display (Page) begins is determined dynamically orstatically. When this field is set to 0xFF, the Button to be set in theselected state as default is determined dynamically. In this case, a PSRin the playback apparatus is used preferentially, so that a Buttonspecified by PSR10 is put in the selected state. When this field is notset to 0xFF, on the other hand, the Button to be set in the selectedstate is determined statically. In this case, PSR10 is set to a buttonnumber shown by the default_selected_button_id_ref, and a Buttonspecified by PSR10 is put in the selected state.

The default_activated_button_id_ref shows a Button to be automaticallyset in an activated state if the user does not activate any Buttonbefore a time defined by the selection_time_out_pts. When this field isset to FF, the Button currently in the selected state is automaticallyset in the activated state at the time defined by theselection_time_out_pts. When this field is set to 00, no Button isauto-activated. When this field is set to a value that is neither 00 norFF, the value is interpreted as a valid button number specifying aButton to be auto-activated.

The pallet_id_ref field shows an identifier of a Pallet to be set in aCLUT unit for producing the Interactive Display.

The button_info field defines a Button to be presented on theInteractive Display. FIG. 35 shows a structure of the button_info.Guideline hp1 in the drawing shows a structure of button_info i ofButton i controlled by the ICS, in detail. Each individual Buttonpresented on the Page has three states that are a normal state, aselected state, and an activated state. The normal state is a statewhere the Button is simply displayed. The selected state is a statewhere the Button is focused according to a user operation but theselection of the Button is not confirmed yet. The activated state is astate where the selection of the Button has been confirmed. Since Buttoni has these three states, button_info i has the following fields.

A button_number field specifies a number uniquely identifying Button iin the ICS.

A numerically_selectable_flag field shows a flag indicating whethernumeric selection is available for Button i.

An auto_action_flag field shows whether Button i is to be automaticallyset in the activated state. When the auto_action_flag field is set to ON(bit value “1”), Button i is changed not to the selected state butdirectly to the activated state, when Button i becomes selected. If theauto_action_flag field is set to OFF (bit value “0”), Button i ischanged not directly to the activated state but to the selected state,when Button i becomes selected.

A button_horizontal_position field and a button_vertical_position fieldrespectively show a horizontal position and a vertical position of a topleft pixel of Button i in the Interactive Display.

An upper_button_number field shows a button number of a Button toreceive the selected state when a user operation of pressing the Move Upkey is made while Button i is in the selected state. If this field showsthe button number of Button i, then a user operation of pressing theMove Up key is ignored.

A lower_button_number field, a left_button_number field, and aright_button_number field respectively show button numbers of Buttons toreceive the selected state when user operations of pressing the MoveDown key, the Move Left key, and the Move Right key are performed whileButton i is in the selected state. If any of these fields shows thebutton number of Button i, then a corresponding user operation isignored.

A start_object_id_normal field specifies a beginning one of object_idsthat are serially assigned to a sequence of ODSs used to present thenormal state of Button i in animation.

An end_object_id_normal field specifies a last one of the object_idsthat are serially assigned to the sequence of ODSs used to present thenormal state of Button i in animation. If the end_object_id_normal fieldspecifies the same ID as the start_object_id_normal field, a staticimage of a graphics Object identified by this ID is presented as Buttoni.

A repeat normal_flag_field specifies whether the animation of Button iin the normal state is to be continuously repeated.

A start_object_id_selected field specifies a beginning one of object_idsthat are serially assigned to a sequence of ODSs used to present theselected state of Button i in animation.

An end_object_id_selected field specifies a last one of the object_idsthat are serially assigned to the sequence of ODSs used to present theselected state of Button i in animation. If the end_object_id_selectedfield specifies the same ID as the start_object_id_selected field, astatic image of a graphics Object identified by this ID is presented asButton i.

A repeat_selected_flag field specifies whether the animation of Button iin the selected state is to be continuously repeated. If thestart_object_id_selected field and the end_object_id_selected field havea same value, the repeat_selected_flag field is set to 00.

A start_object_id_activated field specifies a beginning one ofobject_ids that are serially assigned to a sequence of ODSs used topresent the activated state of Button i in animation.

An end_object_id_activated field specifies a last one of the object_idsthat are serially assigned to the sequence of ODSs used to present theactivate state of Button i in animation.

The following describes button commands.

A button command (button_command) is a command that is executed whenButton i is activated. The following commands (i) to (iv) are used asbutton commands, to write a value to a PSR or a GPR or read a value froma PSR or a GPR.

(i) Get value of Player Status Register command (written as “Get valueof Player Status Register (augment)”)

This function acquires a value from a PSR specified by the augment.

(ii) Set value of Player Status Register command (written as “Set valueof Player Status Register (augment 1, augment 2)”)

This function sets a value specified by augment 2, to a PSR specified byaugment 1.

(iii) Get value of General Purpose Register command (written as “Getvalue of General Purpose Register (augment)”)

This function acquires a value from a GPR specified by the augment.

(iv) Set value of General Purpose Register command (written as “Setvalue of General Purpose Register (augment 1, augment 2)”)

This function sets a value specified by augment 2, to a GPR specified byaugment 1.

<Specific Example>

This concludes the description of the structure of the ICS. A specificexample of interactive control by the ICS is given below. This specificexample uses an ICS and ODSs shown in FIG. 36. FIG. 36 shows arelationship between the ICS and the ODSs included in DSn. The ODSs aremade up of ODS11 to ODS19, ODS21 to ODS29, ODS31 to ODS39, and ODS41 toODS49. ODS11 to ODS19 represent each state of Button 1-A, ODS21 to ODS29represent each state of Button 1-B, ODS31 to ODS39 represent each stateof Button 1-C, and ODS41 to ODS49 represent each state of Button 1-D, asindicated by the parenthesis “}” in the drawing. The ICS contains pageinformation (1), (2), and (3) corresponding to three Pages 1 to 3.Status control of Buttons 1-A to 1-D is defined in button_info (1), (2),(3), and (4) in page information (1) of Page 1 (as indicated by arrowsbh1, bh2, bh3, and bh4 in the drawing).

When timing of the control by the ICS matches presentation timing ofpicture data pt1 of a moving picture shown in FIG. 37, Page 1 out of thethree Pages (Pages 1 to 3) available for presentation by the ICS isoverlaid on picture data pt1 and displayed (gs2). Thus, an InteractiveDisplay provided with a plurality of Buttons is presented incorrespondence with the contents of the moving picture. In this way,realistic presentation using Buttons can be achieved through the use ofan ICS.

FIG. 39 shows an example of ICS description for defining statustransitions of Buttons 1-A to 1-D shown in FIG. 38. Arrows hh1 and hh2in FIG. 38 represent status transitions defined by neighbor_info( ) inbutton_info(1), which is associated with Button 1-A. Thelower_button_number field in the neighbor_info( ) in button_info(1) isset to specify Button 1-C. Accordingly, when a user operation ofpressing the Move Down key is made while Button 1-A is in the selectedstate (up1 in FIG. 38), Button 1-C receives the selected state (sj1 inFIG. 38). The right_button_number field in the neighbor_info( ) inbutton_info(1) is set to specify Button 1-B. Accordingly, when a useroperation of pressing the Move Right key is made while Button 1-A is inthe selected state (up2 in FIG. 38), Button 1-B receives the selectedstate (sj2 in FIG. 38).

Arrow hh3 in FIG. 38 indicates control of a status transition defined byneighbor_info( ) in button_info(3). The upper_button_number field in theneighbor_info( ) in button_info(3), which is associated with Button 1-C,is set to specify Button 1-A. Accordingly, when a user operation ofpressing the Move Up key is made while Button 1-C is in the selectedstate (up3 in FIG. 38), Button 1-A is put back to the selected state(sj3 in FIG. 38). Button 1-A corresponds to a button command “Set Page2”. This command instructs the playback apparatus to switch to Page 2.Upon activation of Button 1-A, this command is executed, as a result ofwhich Page 1 is switched to Page 2 as shown in FIG. 40.

<Playback Apparatus>

This concludes the description of the improvements in the recordingmedium of the third embodiment. The following describes the playbackapparatus of the third embodiment. Of the plurality of PSRs in theplayback apparatus, PSR0, PSR11, and PSR10 relate to the interactivefunction. PSR0, PSR10, and PSR11 are explained below, with reference toFIG. 41.

PSR0 specifies one of a plurality of IG streams which are listed asentries in the STN_table of the current PlayItem.

PSR1 specifies, when the IG stream specified by PSR0 contains aplurality of Pages available for presentation, one of the plurality ofPages.

PSR10 specifies, when the Page specified by PSR11 has a plurality ofButtons, one of the plurality of Buttons.

To realize the interactive function, PSR0 makes the following statustransitions. PSR0 is initially set at 1, and can be set to any of thevalues 2 to 32 by the playback apparatus. FIG. 42A shows statustransitions that can be made by PSR0. FIG. 42B is a flowchart of“Procedure when playback condition is changed” for PSR0. FIG. 43 is aflowchart of “Procedure when change is requested” for PSR0. These statustransitions and flowcharts are same as those of PSR1 and PSR2 describedin the first embodiment. As in the case of audio streams andPG_textST_streams, when IG streams corresponding to multiple languagesare multiplexed in the AV Clip, one of the IG streams that matches thelanguage setting of the playback apparatus is selected and played back.Here, the playback apparatus selects the IG stream depending on theorder of entries in the STN_table. Therefore, by adjusting the order ofentries in the STN_table, the author can control which IG stream is tobe selected. This concludes the description of the status transitions ofPSR0.

PSR10 and PSR11 make status transitions similar to those described inthe first and second embodiments, too. This will be described in detaillater.

The following describes a construction of the playback apparatus of thethird embodiment. PSR0 specifies the IG stream to be played. This beingso, the control unit 24 and the Demultiplexer 3 perform the followingprocessing.

The control unit 24 extracts a PID from one of the entry-attributecombinations of IG streams in the STN_table that is specified by PSR0,and sets the PID in the Demultiplexer 3.

The Demultiplexer 3 outputs, from among TS packets read from the BD-ROMand the HD, TS packets having the PID set by the control unit 24, to theInteractive Graphics Decoder 13. Hence an ICS, a PDS, and an ODS are fedto the Interactive Graphics Decoder 13.

<Internal Construction of the Interactive Graphics Decoder 13>

An internal construction of the Interactive Graphics Decoder 13 isdescribed below, with reference to FIG. 44. As shown in the drawing, theInteractive Graphics Decoder 13 includes a Coded Data Buffer 33, aStream Graphics Processor 34, an Object Buffer 35, a Composition Buffer36, and a Graphics Controller 37.

The Coded Data Buffer 33 is a buffer for temporarily storing an ICS, aPDS, and an ODS together with DTSs and PTSs.

The Stream Graphics Processor 34 decodes the ODS to obtain uncompressedgraphics, and writes the uncompressed graphics to the Object Buffer 35.

The Object Buffer 35 is a buffer for storing a plurality of sets ofuncompressed graphics (represented by the rectangles in the drawing)generated by the Stream Graphics Processor 34.

The Composition Buffer 36 is a memory for storing an ICS. TheComposition Buffer 36 outputs a plurality of sets of page information inthe ICS and a plurality of button_info structures in each set of pageinformation, to the Graphics Controller 37.

The Graphics Controller 37 refers to each button_info structure in pageinformation specified by PSR11 (current page information) out of theplurality of sets of page information in the ICS stored in theComposition Buffer 36, and renders graphics. In detail, the GraphicsController 37 reads graphics specified by a start_object_id_normal fieldvalue and an end_object_id_normal field value of normal_state_info ofeach button_info structure in the current page information from theObject Buffer 35, and writes the read graphics to the InteractiveGraphics Plane 15. Regarding a button_info structure specified by PSR10,the Graphics Controller 37 reads graphics specified by astart_object_id_selected field value and an end_object_id_selected fieldvalue of selected_state_info of the button_info structure from theObject Buffer 35, and writes the read graphics to the InteractiveGraphics Plane 15. Arrows bg1, bg2, bg3, and bg4 in FIG. 44 representthe rendering of the graphics by the Graphics Controller 37. As a resultof the rendering, a Page including Buttons 1-A to 1-D is stored on theInteractive Graphics Plane 15 and overlaid on a moving picture.

This concludes the rough description of the procedure to be performed bythe Graphics Controller 37. FIGS. 45 to 51 show the procedure to beperformed by the Graphics Controller 37 in greater detail.

FIG. 45 is a flowchart of a main routine of the procedure performed bythe Graphics Controller 37. In this flowchart, while conducting step S88(an animation procedure) and step S89 (an UO procedure), judgments aremade in steps S81, S82, and S83 as to whether specific events haveoccurred. If any of the events has occurred, corresponding steps areperformed and the procedure returns to the main routine.

A judgment is made as to whether the current playback time has reached apoint when the ICS becomes valid (S81). If the judgment in step S81 isYES, PSR10 is set to specify first page information in the ICS (S84).After this, a current page display procedure is carried out (S85).

A judgment is made as to whether the current playback time has reached apoint shown by the selection_time_out_pts (S82). If the judgment in stepS82 is YES, a button activation procedure is carried out (S86).

A judgment is made as to whether the current playback time has reached apoint shown by the composition_time_out_pts (S83). If the judgment instep S83 is YES, the Interactive Graphics Plane 15 is cleared and PSR10and PSR11 are changed to Invalid (S87). This completes thesynchronization procedure using time stamps. In this synchronizationprocedure, steps S85 and S86 are performed by calling subroutines. Aprocedure of the subroutine of step S85 is described below, withreference to FIG. 46.

FIG. 46 is a flowchart of an initial display procedure. A display effectspecified by the in_effects field of the current page information isexecuted (S91). After this, a current button setting procedure isperformed (S92). The current Button is specified by PSR10. Accordingly,“Procedure when playback condition is changed” for PSR10 is performed todetermine the current Button. Once the current Button has beendetermined as a result of step S92, the procedure advances to steps S93to S98.

Steps S93 to S98 form a loop that is performed for each button_infostructure in the current Page (S93 and S94). Button-info to be processedin this loop is called button_info(p).

A judgment is made as to whether button_info(p) corresponds to thecurrent Button (S95). If the judgment in step S95 is YES, the procedureadvances to step S96. If the judgment in step S95 is NO, the procedureadvances to step S97.

In step S96, a graphics Object specified by a start_object_id_selectedfield value of selected_state_info in button_info(p) is designated asgraphics Object(p)_in the Object Buffer 35.

In step S97, a graphics Object specified by a start_object_id_normalfield value of normal_state_info in button_info(p) is designated asgraphics Object(p) in the Object Buffer 35.

Once graphics Object(p) has been designated as a result of step S96 orS97, graphics Object(p) is written onto the Interactive Graphics Plane15 at a position specified by a button_horizontal_position field valueand a button_vertical_position field value in button_info(p) (S98). As aresult of performing this operation for each button_info structure inthe current Page, among a plurality of graphics Objects associated witheach button state, an initial graphics Object is rendered for eachButton to the Interactive Graphics Plane 15.

A procedure of the subroutine of step S86 is explained next, withreference to FIG. 47.

FIG. 47 is a flowchart of a button auto-activation procedure. A judgmentis made as to whether a default_activated_button_id_ref is 00 or FF(S100). If the default_activated_button_id_ref is 00, the procedurereturns to the main routine without performing any step. If thedefault_activated_button_id_ref is FF, current Button i is activated(S102). Following this, variable animation(i) corresponding to currentButton i is set to 0. The procedure then returns to the main routine(S103).

If the default_activated_button_id_ref is neither 00 nor FF, a Buttonspecified by the default_activated_button_id_ref is set as currentButton i (S101), and current Button i is activated (S102). Followingthis, animation(i) corresponding to current Button i is set to 0. Theprocedure then returns to the main routine (S103).

As a result of the above procedure, a Button in the selected state isactivated after a predetermined time period. This concludes thedescription of the flowchart of FIG. 47.

The following describes a procedure of animation display on a Page. FIG.48 is a flowchart of the animation display procedure.

The initial display is presented by writing the graphics Objectspecified by the start_object_id_normal in the normal_state_info or thestart_object_id_selected in the selected_state_info in each button_infostructure, onto the Interactive Graphics Plane 15. Animation means anoperation of updating each Button image by overwriting the InteractiveGraphics plane 15 with an arbitrary one of a sequence of graphicsObjects (qth graphics Object) associated with the Button, in eachrepetition of the main routine. That is to say, each Button is presentedin animation by rendering a sequence of graphics Objects associated withthe normal_state_info or selected_state_info provided within eachbutton_info structure, one by one to the Interactive Graphics Plane 15.Here, variable q is used to specify an individual graphics Objectassociated with the normal_state_info or selected_state_info providedwithin each button_info structure.

The animation display procedure is described below, by referring to FIG.48. For simplicity's sake, this flowchart is based on a premise that therepeat_normal_flag and the repeat_selected_flag in each button_infostructure in the ICS are set to indicate that the continuous repetitionis required.

A judgment is made as to whether the initial display has been performed(S110) If the initial display is not yet performed, the procedurereturns to the main routine without performing any step. If the initialdisplay has been performed, the procedure advances to steps S111 toS123. Steps S111 to S123 form a loop in which steps S113 to S123 areperformed for each button_info structure (button_info(p)) of the currentpage information in the ICS (S111 and S112).

Variable q is set to the value of animation(p) corresponding tobutton_info(p) (S113). As a result, variable q represents the currentframe number for button_info(p).

A judgment is made as to whether button_info(p) corresponds to thecurrent Button, i.e. the Button which is currently in the selected state(S114).

If the judgment in step S144 is NO, a value obtained by adding variableq to the start_object_id_normal of the normal_state_info inbutton_info(p) is set as ID(q) (S115).

If the judgment in step S114 is YES, the procedure advances to stepS116.

In step S116, a judgment is made as to whether the current Button is inthe activated state. If the current button is in the activated state, avalue obtained by adding variable q to the start_object_id_activated ofthe actioned_state_info in button_info(p) is set as ID(q) (S117). Afterthis, one of button commands in button_info(p) is executed (S118).

If the current Button is not in the activated state, a value obtained byadding variable q to the start_object_id_selected of theselected_state_info in button_info(p) is set as ID(q) (S119).

Once ID(q) has been determined in this way, graphics Object(q)identified by ID(q) is read from the Object Buffer 35 and written to theInteractive Graphics Plane 15 at a position shown by thebutton_horizontal_position and the button_vertical_position inbutton_info(p) (S120).

As a result, the qth graphics Object in the sequence of graphics Objectsrepresenting the selected state (or the activated state) of the currentButton or the normal state of any of the other Buttons in animation isobtained on the Interactive Graphics Plane 15.

A judgment is made as to whether the sum of the start_object_id_normaland variable q has reached the end_object_id_normal in button_info(p)(S121). If the judgment in step S121 is NO, variable q is incremented by1 and assigned to animation(p) (S122). If the judgment in step S121 isYES, animation(p) is initialized to 0 (S123). The above operation isrepeated for each button_info structure of the current page informationin the ICS (S111 and S112). Once the operation has been completed forall button_info structures, the procedure returns to the main routine.

As a result of steps S110 to S123, each Button image on the InteractiveDisplay is updated using a new graphics Object each time the mainroutine is performed. Repeating the main routine over and over againenables the Button images to be presented in animation. When presentingthe Buttons in animation, the Graphics Controller 37 adjusts theduration for presenting each graphics Object so as to maintain theanimation_frame_rate_code.

A button command execution procedure is explained below, with referenceto a flowchart of FIG. 49. One button_command is extracted from in thebutton_info (S131). A judgment is made as to whether the button_commandis a Page switching command (S132). If the button_command is not a Pageswitching command, the button_command is executed (S133). If thebutton_command is a Page switching command, a display effect specifiedby the out_effects in the current Page is executed (S134). Followingthis, a switching destination page number specified by an operand of thebutton_command is set as X, and a button number specified by an operandof the button_command is set in PSR10 (S135). After this, “Procedurewhen change is requested” for PSR11 is performed (S136). PSR11 specifiesthe current Page. By performing “Procedure when change is requested” forsuch PSR11, the current Page is determined. After this, “Procedure whenplayback condition is changed” is performed for PSR10. This completesthe button command execution procedure.

This concludes the description of the button command executionprocedure. The following describes an UO procedure in step S89 of themain routine, with reference to FIG. 50.

FIG. 50 is a flowchart of the UO procedure. In this flowchart, stepsS140 to S143 are performed to judge whether specific events haveoccurred. If any of the events has occurred, corresponding steps areperformed and then the procedure returns to the main routine. A judgmentis made as to whether the UO_mask_table in the current Page is set to 1(S140). If the judgment in step S140 is YES, the procedure returns tothe main routine without performing any step.

A judgment is made as to whether any of the Move Up key, the Move Downkey, the Move Left key, and the Move Right key has been pressed (S141).If the judgment in step S141 is YES, a current Button change procedureis performed (S147), and a judgment is made as to whether theauto_action_flag of the current Button is 01 (S148). If the judgment instep S148 is NO, the procedure returns to the main routine. If thejudgment in step S148 is YES, the procedure advances to step S144.

A judgment is made as to whether a numeric input has been made (S143).If the numeric input has been made, a numeric input operation isperformed (S146). After this, the procedure returns to the main routine.

A judgment is made as to whether the Activated key has been pressed(S142). If the judgment in step S142 is YES, current Button i isactivated (S144). After this, animation(i) is set to 0 (S145). In theprocedure shown in FIG. 50, step S147 is performed by calling asubroutine. FIG. 51 shows a procedure of this subroutine.

FIG. 51 is a flowchart of a current button change procedure. First, fromthe upper_button_number, the lower_button_number, theleft_button_number, and the right_button_number in the neighbor_infoassociated with the current Button, a button number that corresponds tothe pressed key is specified (S150).

The current Button is set as button Y, and a new Button identified bythe specified button number is set as Button X (SI51). To set PSR10 toX, “Procedure when change is requested” is performed (S152).

After the setting, animation(X) and animation(Y) are set to 0. Theprocedure then returns to the main routine (S153).

This concludes the description of the procedures performed by theInteractive Graphics Decoder 13.

<Specific Examples of Focus Shift>

In the above Page switching, the author decides which Button in theswitch destination Page is to be set in the selected state. This raisesan issue of how to perform a focus shift. A focus referred to hereindicates a Button which is in the selected state. A focus shift is todynamically or statically change the Button in the selected state inaccordance with Page switching, using the aforementioned button commandor default selected button.

The following describes a focus shift for aiding the viewing of apackage medium on which a plurality of sets of content such as a dramaseries are recorded. In the package medium recording the drama series,content corresponding to each of the episodes such as the first tofourth episodes is contained in one disc. In this case, playback isgenerally performed in the order of episodes, i.e. the first episode→the second episode→the third episode→the fourth episode. This being so,it is troublesome for the user to perform, on a selection menu, anoperation of selecting the next episode each time playback of oneepisode ends.

FIG. 52 shows a specific example of this selection operation. In thedrawing, the selection menu has Buttons corresponding to the first tofourth episodes. When the selection of one Button is confirmed, achapter menu for an episode corresponding to that Button is displayed.After the display of the chapter menu, the selection menu is displayedagain. On this selection menu, the user needs to perform a key operationto select the next episode. In detail, when a chapter menu of the firstepisode is displayed (hw1) and then the selection menu is displayedagain (hw2), the user needs to perform a key operation (ks1) to selectthe second episode.

Also, when a chapter menu of the second episode is displayed (hw3) andthen the selection menu is displayed again (hw4), the user needs toperform a key operation (ks2) to select the third episode.

A focus shift alleviates such a trouble of having to perform keyoperations. The following describes a procedure of performing a focusshift. FIG. 53 shows how Pages 1 to 4 shown in FIG. 52 are assigned tothe selection menu and the chapter menus. Here, Page 1 is assigned tothe selection menu, Page 2 is assigned to the chapter menu of the firstepisode, Page 3 is assigned to the chapter menu of the second episode,and Page 4 is assigned to the chapter menu of the third episode.

Also, Buttons 1-A to 1-D on Page 1 are assigned respectively toselection Buttons for the first to fourth episodes in the selectionmenu, and Buttons 2-A to 2-F on Page 2 are assigned respectively toselection Buttons for chapters 1 to 5 and a return Button in the chaptermenu of the first episode. The return Button referred to here is aButton for accepting a user operation of displaying the selection menuagain.

This being the case, button commands of Button 1-A on Page 1 and buttoncommands of Button 2-F on Page 2 define procedures such as those shownin FIG. 54. Procedures defined by the button commands of Button 1-A arethe following. When the selection of Button 1-A is confirmed, (1) thevalue of PSR10 is saved to a GPR, (2) PSR11 is set to 2, and (3) PSR10is set to 1.

By setting the PSRs in this way, the chapter menu of the first episodeis displayed with Button 2-A being in the selected state.

Meanwhile, procedures defined by the button commands of Button 2-F arethe following. When the selection of Button 2-F is confirmed, (1) PSR11is set to 1, and (2) PSR10 is set to a sum of 1 and the value saved tothe GPR.

According to these procedures defined by the button commands of Button1-A on Page 1 and Button 2-F on Page 2, when the display of the chaptermenu of the first episode ends and the selection menu is displayedagain, the focus is automatically shifted from the Button for the firstepisode to the Button for the second episode on the selection menu. Bydefining button commands of Buttons 1-B to 1-D on Page 1 and the Buttonsof the other Pages in a similar way, focus shifts such as those shown inFIG. 55 can be realized.

With the aid of such focus shifts, the user can easily search the dramaseries made up of a number of sets of content, for a chapter which he orshe wants to view.

To realize the above focus shifts, it is necessary to define buttoncommands for each individual Button. This being so, if there are manyPages and Buttons, a bug may occur. This raises the need for conductinga test to find bugs.

Bugs likely to occur in focus shifts are as follows. When displayingPage 1, if the above procedures are performed while Button 1-D is in theselected state, a button number (=5) obtained by adding 1 to a buttonnumber of Button 1-D is written to PSR10 upon switching from Page 1,Page 2, and back to Page 1. Since Page 1 does not have a fifth Button,the focus will end up being shifted to a nonexistent Button on Page 1.Also, there may be a case where after the sixth Button (Button 1-F) onPage 2 is set in the selected state, Page 1 is displayed again withoutupdating PSR10, as shown in FIG. 56. In this case too, the focus willend up being shifted to a nonexistent Button on Page 1. Thus, when thenumber of Buttons on each Page is different, a bug of putting anonexistent Button on a switch destination Page into the selected statecan occur frequently. Such defects need be corrected upon shipment ofcontent. Accordingly, the author must perform a debug test to ensurenormal operations, as in the case of shipment of programs. However, theimperative for the author to perform such a debug test as beingconducted by a software house may adversely affect the contentproduction that is the core business of the author.

In view of this, the third embodiment of the present invention appliesstatus transitions through “Procedure when playback condition ischanged” and “Procedure when change is requested”, to PSR10 and PSR11 inthe same way as PSR1, PSR2, and PSR3.

<Status transitions of PSR11>

PSR1 specifies a Page which is currently displayed among a plurality ofPages included in the IG stream (current Page). PSR1 takes one of thevalues 00 to FF, and the playback apparatus displays the Page specifiedby PSR11. FIG. 57A shows status transitions that can be made by PSR11.When comparing this drawing with FIG. 15A, it can be seen that there isno status transition triggered by the “Cross a PlayItem boundary” event.Also, an event that triggers a status transition from Invalid to Validhas been changed from “Start PlayList playback” to “InteractiveComposition Segment becomes Valid”, and an event that triggers a statustransition from Valid to Invalid has been changed from “TerminatePlayList playback” to “Interactive Composition Segment becomes Invalid”.Also, “Procedure when change is requested” has been changed from “streamchange is requested” to “page change is requested. Apart from thesedifferences, FIG. 57A is same as FIG. 15A.

“Interactive Composition Segment becomes Invalid” includes an event thatthe current playback time has reached a point specified by thecomposition_time_out_pts in an ICS, an event that an ICS has changed,and an event that PlayList playback ends. The number of audio streamsdiffers for each PlayItem. Accordingly, when PlayList playback startsand each time a PlayItem boundary is crossed, “Procedure when playbackcondition is changed” needs to be performed to set PSR1. However, PSR11is used only in a playback section where an ICS is multiplexed, and sothere is no need to perform “Procedure when playback condition ischanged” each time a PlayItem boundary is crossed. Therefore, a statustransition from Invalid to Valid of PSR11 is triggered by an event thatan ICS becomes Valid.

“Procedure when playback condition is changed” for PSR11 is explainedbelow. FIG. 57B is a flowchart of “Procedure when playback condition ischanged” for PSR11. In “Procedure when playback condition is changed”,first page information in the ICS is set in PSR11 (S154).

FIG. 57C is a flowchart of “Procedure when change is requested” forPSR11. A judgment is made as to whether X is Valid (S155). If X isValid, X is assigned to PSR1 (S156). If X is Invalid, the value of PSR11is maintained (S157). This concludes the description of PSR11.

<Status Transitions of PSR10>

The following describes status transitions of PSR10. FIG. 58A showsstatus transitions that can be made by PSR10. This drawing is same asFIG. 57A, except that a status transition triggered by an event “ChangePage” or “Button Disabled” has been added. Also, “Procedure when changeis requested” has been changed from “page change is requested” to“button change is requested”.

“Change Page” is an event that Page switching is requested. “ButtonDisabled” is an event that a Button displayed on a Page is disabled.Upon the occurrence of such an event, “Procedure when playback conditionis changed” is performed to set PSR10, and then PSR10 returns to Valid.

“Procedure when playback condition is changed” and “Procedure whenchange is requested” for PSR10 are described below.

FIG. 58B is a flowchart of “Procedure when playback condition ischanged” for PSR10.

A judgment is made as to whether the default_selected_button_id_ref inthe current Page is Valid (S161). If the judgment in step S161 is YES,PSR10 is set to the default_selected_button_id_ref (S162).

If the judgment in step S161 is NO, a judgment is made as to whetherPSR10 is Valid (S163). If PSR10 is Valid, the value of PSR10 ismaintained (S164). If PSR10 is Invalid, PSR10 is set to a button numberof the first button_info structure in the current Page (S165).

FIG. 59 is a flowchart of “Procedure when change is requested” forPSR10. First, a judgment is made as to whether X is Valid (S166). If Xis Valid, PSR10 is set to X (S168). If X is Invalid, the value of PSR1is maintained (S167).

According to the above procedures, when PSR10 is Invalid, PSR10 is setso that the Button specified by the first button_info structure of thecurrent Page is set in the selected state. Accordingly, even if theauthor designates a button number of a Button which does not exist in aswitch destination Page, a process of changing the wrong button numberto a correct button number is automatically performed. Thus, even if abutton command for realizing a focus shift has a defect, such a defectcan be automatically corrected. This reduces the burden on the author.

Modifications

Though the present invention has been described by way of the aboveembodiments, the present invention is not limited to such. The presentinvention can be realized with any of modifications (A) to (M) givenbelow. The invention of each of the claims of this application includesextension and generalization of the above embodiments and theirmodifications below. The degree of extension and generalization dependsupon the state of the art in the technical field of the presentinvention at the time of filing of this application.

(A) The above embodiments describe the case where the BD-ROM is used asthe recording medium according to the present invention. Main featuresof the present invention, however, lie in a graphics stream recorded onthe recording medium, which does not rely on physical characteristics ofBD-ROMs. Therefore, the present invention is applicable to any recordingmedium that is capable of recording a graphics stream. Examples of sucha recording medium include: an optical disc such as a DVD-ROM, aDVD-RAM, a DVD-RW, a DVD-R, a DVD+RW, a DVD+R, a CD-R, or a CD-RW; amagneto-optical disk such as a PD or an MO; a semiconductor memory cardsuch as a CompactFlash card, a SmartMedia card, a Memory Stick card, aMultiMediaCard, or a PCMCIA card; a magnetic disk such as a flexibledisk, SuperDisk, Zip, or Clik!; a removable hard disk drive such as ORB,Jaz, SparQ, SyJet, EZFley, or Microdrive, and a nonremovable hard diskdrive.

(B) The above embodiments describe the case where the playback apparatusdecodes an AV Clip on the BD-ROM and outputs the decoded AV Clip to thetelevision. As an alternative, the playback apparatus may be equippedwith only a BD-ROM drive, with the remaining construction elements beingprovided in the television. In this case, the playback apparatus and thetelevision can be incorporated in a home network connected with an IEEE1394 connector. The above embodiments describe the case where theplayback apparatus is connected to the television, but the playbackapparatus may instead be integrated with a display device. Also, theplayback apparatus may include only the system LSI (integrated circuit)which constitutes an essential part of processing. The playbackapparatus and the integrated circuit are both an invention described inthis specification. Accordingly, regardless of whether the playbackapparatus or the integrated circuit is concerned, an act ofmanufacturing a playback apparatus based on the internal construction ofthe playback apparatus described in the first embodiment is an act ofworking of the present invention. Also, any act of assigning with charge(i.e. for sale) or without charge (i.e. as a gift), leasing, andimporting the playback apparatus is an act of working of the presentinvention. Likewise, an act of offering for assignment or lease of theplayback apparatus using storefront displays, catalogs, or brochures isan act of working of the present invention.

(C) Information processing using the programs shown in the flowcharts isactually realized using hardware resources. Accordingly, the programswhich describe the operational procedures shown in the flowcharts arethemselves an invention. The above embodiments describe the case wherethe programs are incorporated in the playback apparatus, but theprograms can be used independently of the playback apparatus. Acts ofworking of the programs include (1) an act of manufacturing, (2) an actof assigning with or without charge, (3) an act of leasing, (4) an actof importing, (5) an act of providing to the public via a bi-directionalelectronic communications network, and (6) an act of offering forassignment or lease using storefront displays, catalogs, or brochures.

(D) The time elements of the steps which are executed in a time seriesin each of the flowcharts can be regarded as the necessary elements ofthe present invention. This being so, a playback method shown by theseflowcharts is an invention. If the processing shown in each flowchart iscarried out by performing the steps in a time series so as to achievethe intended aim and the intended effect, this is an act of working ofthe recording method of the present invention.

(E) When recording an AV Clip on the BD-ROM, an extension header may beadded to each TS packet in the AV Clip. The extension header is called aTP_extra_header, includes an arrival_time_stamp and acopy_permission_indicator, and has a data length of 4 bytes. TS packetswith TP_extra_headers (hereafter “EX TS packets”) are grouped in unitsof 32 packets, and each group is written to three sectors. One groupmade up of 32 EX TS packets has 6,144 bytes (=32×192), which isequivalent to a size of three sectors that is 6144 bytes (=2048×3). The32 EX TS packets contained in the three sectors are called an AlignedUnit.

In a home network connected with an IEEE 1394 connector, the playbackapparatus transmits an Aligned Unit in the following manner. Theplayback apparatus removes a TP_extra_header from each of the 32 EX TSpackets in the Aligned Unit, encrypts the body of each TS packetaccording to the DTCP Specification, and outputs the encrypted TSpackets. When outputting the TS packets, the playback apparatus insertsan isochronous packet between adjacent TS packets. A position where theisochronous packet is inserted is based on a time shown by anarrival_time_stamp of the TP_extra_header. The playback apparatusoutputs a DTCP_descriptor, as well as the TS packets. TheDTCP_descriptor corresponds to a copy_permission_indicator in theTP_extra_header. With the provision of the DTCP_descriptor indicating“copy prohibited”, it is possible to prevent, when using the TS packetsin the home network connected with the IEEE 1394 connector, the TSpackets from being recorded to other devices.

(F) The above embodiments describe the case where an AV Clip of theBlu-ray Disc Read-Only Format is used as a digital stream, but thepresent invention can also be realized with a VOB (Video Object) of theDVD-Video Format or the DVD-Video Recording Format. The VOB is a programstream that complies with the ISO/IEC 13818-1 Standard and is obtainedby multiplexing a video stream and an audio stream. Also, the videostream in the AV Clip may be an MPEG4 video stream or a WMV videostream. Further, the audio stream in the AV Clip may be a Linear PCMaudio stream, an MP3 audio stream, or an MPEG-AAC audio stream.

(G) The movie content described in the above embodiments may be obtainedby encoding an analog image signal broadcast by analog broadcasting.Also, the movie content may be stream data made up of a transport streambroadcast by digital broadcasting.

Alternatively, an analog/digital image signal recorded on a videotapemay be encoded to obtain content. Also, an analog/digital image signaldirectly captured by a video camera may be encoded to obtain content. Adigital work distributed by a distribution server is applicable too.

(H) Graphics Objects described in the above embodiments is run-lengthencoded raster data. Run-length encoding is used forcompression/encoding of graphics Objects, because the run-lengthencoding is most suitable for compression and decompression ofsubtitles. Subtitles have a property in that a continuous length of thesame pixel value in a horizontal direction is relatively long.Therefore, by performing compression using run-length encoding, a highcompression rate can be attained. In addition, run-length encodingreduces a load for decompression, and is therefore suitable forrealizing decoding by software. For the purpose of providing a decodingconstruction common to subtitles and Buttons, the compression anddecompression method used for subtitles is also employed for Buttons.Nevertheless, the use of run-length encoding for graphics Objects is nota limitation of the present invention. For example, graphics Objects maybe PNG data. Also, graphics Objects may be vector data instead of rasterdata. Further, graphics Objects may be transparent patterns.

(I) Subtitle graphics selected according to a display setting of theplayback apparatus may be subjected to display effects of PCSs. Forexample, graphics of various display modes such as wide screen, pan andscan, and letterbox are recorded on the BD-ROM, and the playbackapparatus selects one of these display modes according to a displaysetting of the television connected with the playback apparatus anddisplays corresponding graphics. Since the display effects of PCSs areapplied to such subtitle graphics, viewability increases. As a result,display effects achieved by using characters which are contained withinthe body of video can be realized with subtitle graphics displayedaccording to the display setting. This contributes to high practicality.

(J) The above embodiments describe the case where the playback apparatusincludes a Graphics Plane. Alternatively, the playback apparatus mayinclude a line buffer for storing uncompressed pixels of one line. Sinceconversion to an image signal is performed for each horizontal row(line), conversion to an image signal can equally be performed with theline buffer.

(K) The third embodiment describes the case where button commands forsetting PSR10 and PSR11 are written in an ICS, but button commands forsetting PSR1, PSR2, and PSR3 may be written in the ICS too. For example,if PSR2 specifies English subtitles, button commands for selectingJapanese subtitles may be provided.

(L) A default Button may be provided on each of an audio selection menuand a subtitle selection menu used for receiving an audio streamselection and a subtitle stream selection. Button informationcorresponding to such a default Button has button commands for settingPSR1 or PSR2 to an undefined value. If the default Button is activatedand these button commands are executed, PSR1 or PSR2 is set to theundefined value, and “Procedure when playback condition is changed” isperformed to select an optimal audio stream or PG_textST_stream.

(M) The first embodiment describes the case where the three conditions(a) to (c) are used, but the number of conditions may be four or more.

INDUSTRIAL APPLICABILITY

The above embodiments disclose the internal construction of the playbackapparatus to which the present invention relates, and the playbackapparatus can be manufactured in volume based on the disclosed internalconstruction. In other words, the playback apparatus are capable ofbeing industrially used. Hence the playback apparatus has industrialapplicability.

NUMERICAL REFERENCES

1 . . . BD drive

2 . . . Read Buffer

3 . . . Demultiplexer

4 . . . Video Decoder

5 . . . Video Plane

9 . . . Presentation Graphics Decoder

10 . . . Presentation Graphics Plane

11 . . . adder

12 . . . Font Generator

13 . . . Interactive Graphics Decoder

14 . . . switch

15 . . . Interactive Graphics Plane

16 . . . adder

17 . . . Controller

18 . . . Read Buffer

19 . . . Demultiplexer

20 . . . Audio Decoder

21 . . . switch

22 . . . switch

23 . . . scenario memory

24 . . . control unit

25 . . . switch

26 . . . CLUT unit

27 . . . CLUT unit

28 . . . PSR set

29 . . . operation reception unit

30 . . . transition control unit

200 . . . playback apparatus

300 . . . television

400 . . . remote control

1. A playback apparatus for playing back a video stream and an audiostream in accordance with playlist information recorded on a recordingmedium, the playback apparatus characterized by comprising: aconfiguration register operable to indicate, for each encoding method, aconfiguration pertaining to whether surround audio can be output; alanguage setting register operable to indicate a language setting in theplayback apparatus; a stream number register operable to store a streamnumber of an audio stream to be played back; a control unit operable toselect one of a plurality of audio streams by executing a predeterminedprocedure; and a playback unit operable to play back the selected audiostream along with the video stream, wherein the recording mediumincludes a read-only optical disk and a supplementary recording medium,the playlist information includes one or more pieces of playback sectioninformation, the playback section information including playback starttime information, playback end time information, and a stream numbertable, the stream number table indicates a playable audio stream that isrecorded on one of the read-only optical disk and the supplementaryrecording medium, the predetermined procedure includes judging, for eachof a plurality of audio streams indicated in the stream number table,which of a plurality of conditions the audio stream satisfies, andselecting an audio stream according to a combination of conditionsjudged to be satisfied, the plurality of conditions include a firstcondition, a second condition, and a third condition, the firstcondition is that an audio stream has been judged to be playable, bycomparing an encoding method of the audio stream with the configurationregister, the second condition is that a language attribute has beenjudged to match, by comparing a language code of the audio stream withthe language setting register, the third condition is that surroundoutput when performing playback has been judged to be possible, bycomparing a channel structure of the audio stream with the configurationregister, and if there is no audio stream that satisfies all of thefirst condition, the second condition, and the third condition, an audiostream among audio streams satisfying the first condition and the secondcondition is selected to which corresponds an entry in the stream numbertable at a place that indicates a first priority, and a stream number ofthe selected audio stream is set in the stream number register in theplayback apparatus.
 2. The playback apparatus of claim 1, wherein ifthere is no audio stream that satisfies all of the first condition, thesecond condition, and the third condition, no audio stream thatsatisfies the first condition and the second condition, and no audiostream that satisfies the first condition and the third condition, anaudio stream among audio streams satisfying the first condition isselected to which corresponds an entry in the stream number register ata place that indicates a first priority, and a stream number of theselected audio stream is set in the stream number register.
 3. Theplayback apparatus of claim 1, wherein the read-only optical disk andthe supplementary recording medium are recognized as a virtual singledisk by the playback apparatus; the playlist information includes streamfile information that designates, with use of one of an identifyingnumber indicating a stream file storing the audio stream on theread-only optical disk and an identifying number indicating a streamfile storing the audio data on the supplementary recording medium, oneof the stream file storing the audio stream on the read-only opticaldisk and the stream file storing the audio data, in the stream numbertable, an audio stream that is judged to be playable is the audio streamdesignated by the stream file information in the playlist information,the stream number table indicates, for each audio stream, a referencevalue of a stream file information and a reference value of a packetidentifier in correspondence with a stream number, and the playback unitis further operable to perform read control to read, in accordance withthe stream file information in the stream file information and thestream number table in the playlist information, one of a stream file ona read-only disk that stores an audio stream and a stream file on asupplementary recording medium that stores an audio stream, and theplayback unit further comprises: a demultiplex unit operable, if aplurality of packets included in an audio stream are read by the readcontrol, to retrieve, from the stream number table, the reference valueof the packet identifier corresponding to the stream number written inthe stream number register, and to demultiplex packets in accordancewith the reference value of the packet identifier, and an audio decoderoperable to perform audio playback by decoding the packets obtained bythe demultiplexing.
 4. The playback apparatus of claim 1, wherein theaudio stream at the place that indicates the first priority is an audiostream whose stream number is ranked top among the audio streamssatisfying the first condition and the second condition, in the streamnumber table.
 5. The playback apparatus of claim 1, wherein the playlistinformation includes subordinate playback section information, thesubordinate playback section information includes playback start timeinformation indicating a time to start playback of the video stream,playback end time information indicating a time to end playback of thevideo stream, and synchronous time information indicating a synchronoustime on the time axis of the video stream, in the stream number table inthe playback section information, an audio stream recorded on thesupplementary recording medium that is permitted to be played back isthe audio stream designated in the subordinate playback sectioninformation, the control unit executes the predetermined procedure uponplayback section information of a section that is currently being playedback switching to new playback section information, if the audio streamrecorded on the supplementary recording medium is selected in thepredetermined procedure, the playback unit plays back the audio streamin accordance with the subordinate playback section information, andplayback in accordance with the subordinate playback section informationis performed by playing back a portion when a current playback time hasreached the synchronous time indicated in the synchronous timeinformation on a time axis of a video stream, and from a positionindicated in the playback start time information to a position indicatedin the playback end time information of the subordinate playback sectioninformation in the audio stream.
 6. The playback apparatus of claim 1,wherein the control unit executes the predetermined procedure if anoperation requesting a change in the audio stream is performed by auser, and further characterized by comprising: a reception unit operableto receive a stream number X from a user, the stream number X being anumber of a stream that the user desires to select; and thepredetermined procedure includes judging whether the audio streamcorresponding to the stream number received by the reception unit isplayable with reference to a current stream number table, and if judgednot to be playable, judging whether the stream number X is an indefinitevalue, and if judged not to be an indefinite value, maintaining astorage value of the stream number register, and if judged to be anindefinite value, performing processing to judge whether the firstcondition, second condition, and third condition have been satisfied,and selecting an audio stream as a replacement audio stream inaccordance with a result of the judgment.
 7. A playback method forperforming processing on a computer to play back a video stream and anaudio stream in accordance with playlist information recorded on arecording medium, the computer including a configuration registeroperable to indicate, for each encoding method, a configurationpertaining to whether surround audio can be output, a language settingregister operable to indicate a language setting in the computer, and astream number register operable to store a stream number of an audiostream to be played back, the playback method characterized bycomprising the steps of: selecting one of the audio streams by executinga predetermined procedure, and playing back the selected audio streamalong with the video stream, wherein the recording medium includes aread-only optical disk and a supplementary recording medium, theplaylist information includes one or more pieces of playback sectioninformation, the playback section information including playback starttime information, playback end time information, and a stream numbertable, the stream number table indicates a playable audio stream fromamong the plurality of audio streams recorded on the read-only opticaldisk and the supplementary recording medium, the predetermined procedureincludes judging, for each of a plurality of audio streams indicated inthe stream number table, which of a plurality of conditions the audiostream satisfies, and selecting an audio stream according to acombination of conditions judged to be satisfied, the plurality ofconditions include a first condition, a second condition, and a thirdcondition, the first condition is that an audio stream has been judgedto be playable, by comparing a encoding method of the audio stream withthe configuration register, the second condition is that a languageattribute has been judged to match, by comparing a language code of theaudio stream with the language setting register, the third condition isthat surround output when performing playback has been judged to bepossible, by comparing a channel structure of the audio stream with theconfiguration register, and if there is no audio stream that satisfiesall of the first condition, the second condition, and the thirdcondition, an audio stream among audio streams satisfying the firstcondition and the second condition is selected to which corresponds anentry in the stream number table at a place that indicates a firstpriority and a stream number of the selected audio stream is set in thestream number register in the computer.
 8. A program embodied in anon-transitory computer readable medium for causing a computer toexecute processing to play back a video stream and an audio stream inaccordance with playlist information recorded on a recording medium, thecomputer including a configuration register operable to indicate, foreach encoding method, a configuration pertaining to whether surroundaudio can be output, a language setting register operable to indicate alanguage setting in the computer, and a stream number register operableto store a stream number of an audio stream to be played back, theprogram characterized by comprising the steps of: selecting one of theaudio streams by executing a predetermined procedure, and playing backthe selected audio stream along with the video stream, wherein therecording medium includes a read-only optical disk and a supplementaryrecording medium, the playlist information includes one or more piecesof playback section information, the playback section informationincluding playback start time information, playback end timeinformation, and a stream number table, the stream number tableindicates a playable audio stream from among the plurality of audiostreams recorded on the read-only optical disk and the supplementaryrecording medium, the predetermined procedure includes judging, for eachof a plurality of audio streams indicated in the stream number table,which of a plurality of conditions the audio stream satisfies, andselecting an audio stream according to a combination of conditionsjudged to be satisfied, the plurality of conditions include a firstcondition, a second condition, and a third condition, the firstcondition is that an audio stream has been judged to be playable, bycomparing an encoding method of the audio stream with the configurationregister, the second condition is that a language attribute has beenjudged to match, by comparing a language code of the audio stream withthe language setting register, the third condition is that surroundoutput when performing playback has been judged to be possible, bycomparing a channel structure of the audio stream with the configurationregister, and if there is no audio stream that satisfies all of thefirst condition, the second condition, and the third condition, an audiostream among audio streams satisfying the first condition and the secondcondition is selected to which corresponds an entry in the stream numbertable at a place that indicates a first priority and a stream number ofthe selected audio stream is set in the stream number register in thecomputer.